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Phillips  Laboratory  Global  Spectral 
Numerical  Weather  Prediction  Model 


1.  BACKGROUND 

The  Atmospheric  Prediction  Branch  of  the  Phillips  Laboratory  (PL/GPAP)  has 
developed  and  tested  a  global  spectral  numerical  weather  prediction  model,  which  will 
be  referred  to  as  the  Phillips  Laboratory  Global  Spectral  Model  (PL  GSM).  This 
effort  took  place  over  a  ten-year  period  (1981-1991)  and  involved  PL/GPAP  personnel 
and  several  supporting  contract  efforts.  The  model  was  developed  in  response  to  the 
USAF  Air  Weather  Service  (AWS)  Geophysical  Requirement  (GR-3-80),  Improved 
Cloud  Forecast  Technology,  to  provide  the  platform  for  improved  global  cloud 
forecasts.  The  goal  was  to  develop  a  state-of-the-art  global  weather  forecast  model 
with  physical  parameterization  schemes  that  would  forecast  the  atmospheric  state 
(winds,  geopotential  heights,  temperature,  pressure,  and  humidity).  The  horizontal 
and  vertical  cloud  distribution  could  then  be  deduced  on  scales  practical  in  global 
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models  [grid  resolutions  of  0(100  km)]  using  diagnostic  methods  that  relate  cloud 
amount  to  forecasted  variables.  The  model  might  eventually  be  adapted  to  a 
prognostic  cloud  forecasting  capability,  in  which  cloud  water  would  be  an  additional 
prognostic  variable  within  the  model. 

The  purpose  of  this  report  is  to  briefly  review  the  developmental  history  of  the  PL 
GSM,  discuss  its  current  components,  and  document  its  present  performance  in 
forecasting  the  atmospheric  state.  The  balance  of  Section  1  is  devoted  to  the  history 
of  the  PL  GSM  development.  Section  2  describes  the  individual  components  of  the 
various  versions  of  the  PL  GSM.  Section  3  details  the  design  used  in  the  forecast 
experiments,  while  Section  4  includes  a  discussion  of  the  experimental  results.  In 
Section  5,  we  present  our  analysis  and  conclusions  on  the  current  model’s  forecast 
performance.  Section  6  presents  our  recommendations  for  further  improvement, 
testing,  and  evaluation  of  the  PL  GSM. 

The  original  form  of  the  PL  (formerly  the  Air  Force  Geophysics  Laboratory)  GSM 
was  developed  from  the  National  Meteorological  Center’s  global  spectral  model1 
acquired  from  NMC  in  1981.  The  model  was  adapted  for  installation  on  the  local 
computer  system,  and  in  doing  so  the  hydrodynamics  of  the  model  were  completely 
re-coded.  The  physics  of  the  model  (parameterizations  of  moist  processes,  dry 
adiabatic  adjustment,  and  planetary  boundary  layer  fluxes)  were  retained  in  the  form 
described  in  Sela.1  We  refer  to  this  version  of  the  PL  GSM  as  NMC80.  The  original 
implementation  and  studies  of  the  expanded  resolution  (to  30  rhomboidal  spectral 
truncation)  are  described  in  Brenner  et  al.2,3  The  nonlinear  normal  mode 
initialization  procedure  used  to  remove  fast  gravity  modes  from  the  gridded  initial 


'Sela,  J.  (1980)  Spectral  Modeling  at  the  National  Meteorological  Center,  Mon.  Wecu  Rev., 
108:1279-1292. 

"Brenner,  S.,  Yang,  C.,  and  Yee,  S.  (1982)  The  AFGL  Spectral  Model  of  the  Moist  Global 
Atmosphere:  Documentation  of  the  Baseline  Version,  AFGL-TR-82-0393,  Air  Force  Geophysics 
Laboratory,  Hanscom  AFB,  MA.  AD129283. 

"Brenner,  S.,  Yang,  C.,  and  Mitchell,  K  (1984)  The  AFGL  Global  Spectral  Model:  Expanded 
Resolution  Baseline  Version,  AFGL-TR-84-0308,  Air  Force  Geophysics  Laboratory,  Hanscom  AFB,  MA. 
ADA160370. 
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conditions  was  also  acquired  from  NMC.4  Its  impact  on  model  performance  was 
discussed  by  Brenner  et  al.3 

In  1984,  we  acquired  from  NMC,  by  way  of  the  Air  Force  Global  Weather  Central 
(AFGWC),  the  version  of  the  physical  parameterizations  resident  in  the  NMC  model 
that  was  made  operational  at  AFGWC  in  1984.  Upon  replacing  the  NMC80  physics 
with  this  version  of  the  physics  in  our  baseline  model,  we  termed  this  version  of  the 
GSM  GWC84.  The  differences  between  NMC80  and  GWC84  versions  of  the  GSM  are 
presented  by  Yang  et  al.6  GWC84  is  essentially  the  form  of  the  global  spectral  model 
currently  employed  operationally  at  AFGWC.  Because  of  its  status  as  the  operational 
Air  Force  model,  we  use  it  as  a  reference  in  this  report  to  measure  any  improvement 
in  forecast  skill  that  might  be  attributed  to  PL  GSM  development. 

Several  university  research  groups,  under  AFGL  sponsorship,  developed  new 
parameterization  schemes  for  physical  processes  not  resolved  or  explicitly  handled  by 
the  hydrodynamics  of  the  model.  Between  1982  and  1986,  three  university  groups 
developed  first  installments  of  software  for  preliminary  testing  of  a  new  version  of  the 
PL  GSM.  Mahrt  and  others8  at  Oregon  State  University  developed  a  planetary 
boundary  layer  scheme  that  parameterizes  surface  effects  on  the  atmosphere  (fluxes 
of  heat,  moisture,  and  momentum).  Ogura  and  Soong7  at  the  University  of  Illinois 
investigated  and  modified  two  methods  of  parameterizing  moist  convective  processes. 


4Balliah,  B.A.  (1980)  Initialization  Theory  and  Application  to  the  NMC  Spectral  Model,  Ph.D. 
Thesis,  Dept  of  Meteorology,  Univ.  of  Maryland. 

“Yang,  C.-H.,  Mitchell,  K.,  Norquiat,  D.,  and  Yee,  S.Y.K.  (1989)  Diagnostics  for  and  Evaluation  of 
New  Physical  Parameterization  Schemes  for  Global  NWP  Models,  GL-TR-89-0158,  Geophysics 
Laboratory  (AFSC),  Hanacom  AFB,  MA.  ADA228033. 

6Mahrt,  L.,  Pan,  H.,  Paumier,  J.,  and  Troen,  lb  (1984)  A  Boundary  Layer  Parameterization  for  a 
General  Circulation  Model,  AFGL-TR-84-0063,  Air  Force  Geophysics  Laboratory,  Hanscom  AFB,  MA. 
ADA144224. 

7Soong,  S.-T.,  Ogura,  Y.,  and  Kau,  W.-S  (1985)  A  Study  of  Cumulus  Parameterization  in  a  Global 
Circulation  Model,  AFGL-TR-85-0160,  Air  Force  Geophysics  Laboratory,  Hanscom  AFB,  MA. 
ADA170137. 


3 


They  recommended  their  modified  Kuo8  method  for  implementation  in  the  new 
version  of  the  PL  GSM.  Liou  and  others9  at  the  University  of  Utah  developed  a 
scheme  to  parameterize  atmospheric  radiative  transfer  that  was  based  on  broad-band 
emissivity  calculations.  Yanget  al.®  reported  in  detail  on  the  individual  and  collective 
impacts  of  these  preliminary  versions  of  the  new  physical  parameterizations  on  the 
GSM  performance.  They  conducted  a  limited  number  of  prediction  experiments  to 
measure  the  effects  that  the  delivered  schemes  had  on  forecast  performance  with 
respect  to  both  NMC80  and  GWC84.  Later,  more  extensive  prediction  experiments 
with  this  version  (called  GL-87)  confirmed  the  conclusions  of  Yang  et  al.6 

As  the  packages  delivered  by  the  university  groups  were  considered  preliminary, 
the  period  1987-1989  saw  the  continued  improvement  of  the  packages  to  eliminate 
shortcomings  or  over-simplifications.  Mahrt  et  al.10  focused  their  efforts  on 
interactions  between  the  soil  and  the  atmosphere,  as  well  as  on  performance  of  the 
boundary  layer  package  under  very  stable  conditions  and  development  of  a 
formulation  for  boundary  layer  cumulus.  Ou  and  Liou11  extended  the  radiative 
parameterization  scheme  to  variable  resolution  in  the  vertical  in  the  accommodation 
of  up  to  three  cloudy  layers.  Norquist  and  Yang12  sought  to  overcome  shortcomings 
in  the  modified  Kuo  convective  scheme  by  extensive  refinement  of  the  physical 


8Kuo,  H.-L.  (1974)  Further  Studies  of  the  Parameterization  of  the  Influence  of  Cumulus  Convection 
on  Large-Scale  Flow,  J.  Atmos.  ScL,  31:1232-1240. 

®Liou,  K.-N.,  Ou,  S.-C.,  Kinne,  S.,  and  Koenig,  G.  (1984)  Radiation  Parameterization  Programs  for 
Use  in  General  Circulation  Models,  AFGL-TR-84-0217,  Air  Force  Geophysics  Laboratory,  Hanscom 
AFB,  MA.  ADA1 48015. 

10Mahrt,  L.,  Pan,  H.-L,  Ruacher,  P.,  and  Chu,  C.-T.  (1987)  Boundary  Layer  Parameterization  for 
a  Global  Spectral  Model,  AFGL-TR-87-0246,  Air  Force  Geophysics  Laboratory,  Hanscom  AFB,  MA. 
ADA199440. 

uOu,  S.-C.,  and  Liou,  K.-N.  (1988)  Development  of  Radiation  and  Cloud  Parameterization  Programs 
for  AFGL  Global  Models,  AFGL-TR-88-0018,  Air  Force  Geophysics  Laboratory,  Hanscom  AFB,  MA. 
ADA202020. 

12Norquist,  D.  and  Yang,  C.-H.  (1990)  Refinement  and  Testing  of  the  Moist  Convection 
Parameterization  in  the  GL  Global  Spectral  Model,  GL-TR-90-0286,  Geophysics  Laboratory  (AFSC), 
Hanscom  AFB,  MA.  ADA241684. 
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processes  parameterized  in  the  package  as  delivered  by  the  University  of  Illinois.7 
These  efforts  culminated  in  another  round  of  testing  the  newly  developed  schemes. 
Individual  tests  showed  that  the  effect  of  the  modified  PBL  parameterization  differed 
little  from  the  previous  version.  A  significant  mid-tropospheric  cooling  resulted  from 
the  three-cloud-deck  radiative  scheme.  A  more  modest  tropical  cooling  replaced  a 
warm  bias  in  the  tropics.  The  relatively  cooler  tropical  forecast  was  attributed  to  a 
significant  reduction  in  precipitation  (thus  latent  heat)  in  the  refined  convective 
scheme.  The  reduction  brought  the  model’s  precipitation  rate  in  line  with  the 
climatological  precipitation  value.  Because  the  convective  package  was  the  only  one 
of  the  three  enhanced  physics  packages  that  showed  clear  improvement  in  the 
realism  of  its  performance,  it  was  the  only  modified  package  included  in  the  next 
series  of  extensive  forecast  experiments.  These  experiments,  conducted  in  1989  (the 
GSM  version  thus  termed  GL-89),  showed  modest  overall  improvements  in  forecast 
skill  over  GWC84.  The  combination  of  the  originally-delivered  PBL  and  one-cloud- 
deck  radiation  schemes  along  with  the  GL-refined  modified  Kuo  scheme12  resulted  in 
a  tropical  cold  bias  and  a  modest  mid-latitude  wintertime  warm  bias.  These  results 
were  in  contrast  with  the  prevalent  warm  bias  present  in  the  radiation-less  GWC84 
model. 

The  final  round  of  physical  parameterization  development  efforts  (1990-1991)  has 
led  to  the  current  version  of  the  PL  GSM,  referred  to  as  PL-91.  Hahn  and  Chang13 
have  documented  the  changes  they  have  made  to  the  surface  fields  (soil  type, 
vegetation  type)  that  are  provided  to  this  version’s  PBL  parameterization.  Vernekar 
and  others14  at  the  University  of  Maryland  formulated  and  tested  a  gravity  wave 
drag  parameterization  designed  to  simulate  the  effect  that  topographically  induced 
gravity  waves  have  on  winds.  A  silhouette  orography  field  replaces  the  smoothed 
FGGE  Ill-b  (1.875°  latitude-longitude)  topography  when  the  model  incorporates  the 


13Hahn,  D.  and  Chang,  S.(1992)  Land-Surface  Parameterization  in  the  Phillips  Laboratory  Global 
Spectral  Model,  to  be  published  as  a  Phillips  Laboratory  Technical  Report. 

HVernekar,  A.D.,  Zhou,  J.,  and  Kirtman,  B.  (1991)  A  Comparison  of  Systematic  Errors  in  AFGL 
and  COLA  Forecast  Models,  PL-TR-91-2164,  Phillips  Laboratory,  Hanscom  AFB,  MA.  ADA244458. 
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gravity  wave  drag  scheme.  Appendix  A  describes  the  representations  of  topography 
commonly  used  in  global  models.  Schattel16  has  modified  the  cloud  configuration  and 
specification  algorithms  in  the  three-deck-cloud  Utah  radiation  scheme.  A  significant 
reduction  in  the  mid-tropospheric  cooling  resulted  from  this  effort.  Finally,  the  mass 
flux  convective  parameterization  scheme  of  the  current  ECMWF  NWP  model18  was 
acquired  and  has  replaced  the  refined,  modified  Kuo  scheme.12  This  was  motivated 
by  the  shortcomings  of  the  latter  formulation  as  investigated  by  Norquist  and 
Yang.12,17  Although  Mahrt  et  al.18  developed  a  boundary  layer  cloud  diagnostic 
scheme  and  a  gravity  wave  drag  parameterization  in  their  most  recent  work  on  the 
PBL  package,  neither  of  these  two  enhancements  were  implemented  in  the  PL-91 
version  of  the  PBL  scheme.  The  ultimate  selection  of  the  physics  packages  for  the 
PL-91  version  of  the  PL  GSM  was  based  on  extensive  experimentation  with  various 
candidate  versions  of  each  physical  parameterization. 

Concurrent  to  the  global  model  development  was  the  formulation  of  a  cloud- 
diagnosis  technique  by  Mitchell  and  Hahn19  known  as  the  cloud  curve  algorithm. 
This  procedure  makes  use  of  two-week  samples  of  the  most  current  GWC84  forecasts 
and  AFGWC  RTNEPH  cloud  analyses.  From  these  samples,  a  statistical  relationship 
is  developed  between  forecast  relative  humidity  from  GWC84  and  concurrent  cloud 
amounts  from  RTNEPH  at  each  of  several  isobaric  levels,  forecast  lengths,  and 
geographic  regions.  These  relationships  are  then  used  to  infer  cloud  amount  from 


15Schattel,  J.  (1992)  Refinement  and  Testing  of  the  Radiative  Transfer  Parameterization  in  the  PL 
Global  Spectral  Model,  PL-TR-92-2169,  Phillips  Laboratory,  Hanscom  AFB,  MA. 

16Tiedtke,  M.  (1989)  A  Comprehensive  Mass  Flux  Scheme  for  Cumulus  Parameterization  in  Large- 
Scale  Models,  Mon.  Wea.  Rev.,  117:  1779-1800. 

17Norquist,  D.,  and  Yang,  C.  (1992)  Comparing  Model-produced  Convective  Cloudiness  with 
Observations,  Mon.  Wea.  Rev.,  120:  770-786. 

18Mahrt,  L.,  Ek,  M.,  Kim,  J.,  and  Holtslag,  A.A.M.  (1991)  Boundary  Layer  Parameterization  for  a 
Global  Spectral  Model,  PL-TR-91-2031,  Phillips  Laboratory,  Hanscom  AFB,  MA.  ADA235310. 

19Mitchell,  K.,  and  Hahn,  D.  (1989)  Development  of  a  Cloud  Forecast  Scheme  for  the  GL  Baseline 
Global  Spectral  Model,  GL-TR-89-0343,  Geophysics  Laboratory,  Hanscom  AFB,  MA.  ADA231595. 
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forecast  relative  humidity  for  the  ensuing  two  weeks.  Trapnell20  has  tested  the 
scheme  in  several  variations  and  found  that  the  method  is  competitive  with  (and  in 
some  cases  superior  to)  the  trajectory-based  forecasts  produced  by  AFGWC’s 
operational  SLAYER  model21  beyond  24  hours  of  forecast  time. 

Nehrkorn  et  al.22,23  have  designed  and  tested  a  computationally  optimized  version 
of  the  PL  GSM.  Beginning  with  a  generalized  truncation  version  of  the  GSM 
hydrodynamics,  they  have  redesigned  the  computer  code  of  the  model  to  allow  the 
Cray-2  FORTRAN  compiler  to  vectorize  the  computations  more  fully.  Then  for  the 
hydrodynamics  only,  they  have  installed  multitasking  directives  to  perform  parallel 
processing  of  most  of  what  used  to  be  serial  computations.  As  a  result,  they  have 
achieved  speed-ups  of  approximately  two  times  from  the  vectorization  and  of  3.6 
times  due  to  multitasking  on  the  four  CPU  Cray-2.  This  translates  to  a  6-7  times 
reduction  in  the  elapsed  execution  ("wall  clock")  time  of  a  forecast  on  a  dedicated 
Cray-2.  In  addition  to  the  timing  tests,  Nehrkorn  et  al.23  discuss  the  results  of 
forecast  comparisons  of  a  pre-PL-91  version  of  the  PL  GSM  at  40R,  80R,  and  120R 
truncation  horizontal  resolutions. 

2.  SUMMARY  OF  PL  GSM  DESIGN 

Brenner  et  al.2,3  have  described  the  design  of  the  PL  GSM  hydrodynamics.  Their 
discussion  includes  the  horizontal  spectral  representation,  vertical  discretization,  and 
the  time-stepping  utilized  in  the  model.  This  design  was  reconfigured  by  Nehrkorn 


2QTrapnell,  R.  (1992)  Cloud  Curve  Algorithm  Test  Program,  PL-TR-92-2052,  Phillips  Laboratory, 
Hanscom  AFB,  MA.  ADA253918. 

21Crum,  T.D.  (1987)  AFGWC  Cloud  Forecast  Models,  AFGWC  Tech  Note  87/001,  AFGWC,  Air 
Weather  Service  (MAC),  Offutt  AFB,  NE. 

22Nehrkorn,  T.,  Hoffman,  R.N.,  and  Louis,  J.-F.  (1990)  Design  of  an  Enhanced  Global  Spectral 
Model ,  GL-TR-90-0309,  Geophysics  Laboratory  (AFSC),  Hanscom  AFB,  MA.  ADA232123. 

23Nehrkorn,  T.,  Hoffman,  R.N.,  Louis,  J.-F.,  and  Zivkovic,  M.  (1992)  An  Enhanced  Global  Spectral 
Model,  PL-TR-92-2011,  Phillips  Laboratory,  Hanscom  AFB,  MA.  ADA251242. 
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et  al.22*23  to  allow  multitasking  and  vectorization,  as  well  as  in  generalized 
(rhomboidal  or  triangular)  truncation  form.  Figure  1  is  a  flow  chart  showing  the 
order  of  processing  during  a  single  model  time  step.  The  sections  of  code  represented 
by  boxes  in  Figure  1  "Spectral  to  Grid  Transform,"  "Sub-grid  Scale  Diffusion,"  "Time 
Stepping,"  and  "Large-Scale  Precip.  and  Dry  Convective  A^j."  are  virtually  unchanged 
between  the  versions  of  PL  GSM  mentioned  in  Section  1.  Differences  in  these 
routines  between  "NMC80"  and  "GWC84"  versions  of  PL  GSM  are  shown  in  Table  2 
of  Yang  et  al.6  In  all  but  PL-91,  the  box  "Convective  Tendencies"  would  be  labeled 
"Moist  Convective  Adjustment"  and  would  appear  just  after  "Time-Stepping"  in  the 
flow  diagram.  Thus,  Figure  1  is  only  strictly  applicable  to  the  PL-91  version  of  PL 
GSM,  with  all  other  versions  departing  from  Figure  1  in  either  content,  order,  or 
both. 

Table  1  summarizes  the  differences  between  the  five  versions  of  PL  GSM 
developed  and  tested  over  the  period  1981-1991.  Footnotes  noted  in  Table  1  will 
direct  the  reader  to  relevant  references.  This  table  shows  the  evolution  of  the  PL 
GSM  over  the  10-year  development  period.  It  is  obvious  that  we  have  tried  to 
improve  the  parameterization  of  physical  effects  of  sub-grid  scale  processes  that  have 
an  important  impact  on  large-scale  variables. 

The  goal  of  implementing  these  new  schemes  was  to  improve  the  accuracy  of 
model  forecasts.  The  change  from  the  simple  bulk  aerodynamic  planetary  boundary 
layer  (PBL)  formulation  of  NMC80  and  GWC84  to  the  sophisticated  PBL  scheme  of 
Mahrt  et  al.8,10  in  later  versions  necessitated  a  change  in  vertical  resolution  of  the 
model.  Figure  2  shows  the  N12  and  N18  (both  devised  by  NMC)  vertical  structures 
referred  to  in  Table  1.  Also  shown  are  the  isobaric  levels  (in  bars)  where  data  are 
available  in  the  FGGE  Ill-b  analyses  from  which  initial  and  verification  fields  for  the 
model  were  generated  (discussed  further  in  Section  3). 

All  versions  of  the  model  have  been  tested  extensively  at  the  same  horizontal 
resolution  (rhomboidal  30,  or  "R30")  to  isolate  the  effects  of  the  various  schemes  on 
the  model  forecasts.  Only  with  the  recent  multitasking  and  optimization  upgrade  will 
it  now  be  feasible  to  run  the  PL  GSM  at  significantly  higher  horizontal  resolutions. 
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SCHEMATIC  STRUCTURE  OF  THE  PL  GSM 


Figure  1.  Flow  Chart  of  PL-91  Version  of  PL  GSM. 


Table  1.  Comparison  of  Model  Features 
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Indeed,  a  single  case  from  a  pre-PL-91  version  of  the  PL  GSM  has  been  run  at  R80 
and  R120.22  However,  all  forecast  experiments  described  in  this  report  were 
conducted  at  R30. 

3.  EXPERIMENTAL  DESIGN 

We  conducted  a  series  of  10-day  experiments  to  determine  the  extent  of 
improvement  resulting  from  inclusion  of  the  advanced  physical  parameterizations. 
Unless  otherwise  stated,  we  will  refer  to  an  individual  10-day  prediction  as  a  "case", 
and  a  "forecast"  will  refer  to  a  case  evaluated  at  a  specific  time.  Experimental  results 
from  GWC84,  GL-89,  and  PL-91  are  included  in  this  report.  Global  meteorological 
analyses  from  the  First  GARP  (Global  Atmospheric  Research  Program)  Global 
Experiment  (FGGE)  are  employed  as  initial  conditions  and  verifying  analyses  in  the 
experiments.  These  were  the  "final"  (1985/86)  FGGE  Ill-b  initialized  analyses 
(Uppala24),  reanalyzed  using  corrected  and  additional  data  and  new  mass  and  wind 
(Shaw  et  ah26)  and  humidity  (Illari28)  analysis  algorithms.  Because  of  the 
augmented  global  data  observing  systems  during  the  special  observing  periods  (SOP- 
1,  5  January  1979  -  5  March  1979;  SOP-II,  5  May  1979  -  5  July  1979),  these  global 
analyses  are  among  the  most  comprehensive  observation-based  analyses  available. 
Geopotential  height,  horizontal  wind,  vertical  velocity,  temperature,  and  relative 
humidity  are  available  at  19  mandatory  pressure  levels  (see  Figure  2),  along  with 
mean  sea  level  pressure.  All  of  these  fields  are  available  on  a  1.875°  latitude  - 
longitude  grid  at  six-hour  intervals. 


Z4Uppala,  S.  (1986)  The  Assimilation  of  the  Final  Level  IIB  Data  Set  at  ECMWF,  Part  I.  Preprints, 
Scientific  Results  of  the  First  GARP  Global  Experiment,  14-17  January,  1986,  Miami,  FL.  Amer. 
Meteor.  Soc., 24-29. 

25Shaw,  D.B.,  Lonnberg,  P.,  Hollingsworth,  A.,  and  Unden,  P.  (1987)  The  1984/1985  Revisions  of 
the  ECMWF  Assimilation  System,  Quart.  J.  Roy.  Meteor.  Soc.,  113:533-566. 

26Illari,  L.  (1989)  The  Quality  of  Satellite  Precipitable  Water  Content  Data  and  Their  Impact  on 
Analyzed  Moisture  Fields,  Tellus,  41A:  319-337. 
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We  pre-processed  the  FGGE  Ill-b  initialized  final  analyses  for  1200  UTC  on  2,  7, 
12,  17,  22,  27  January,  and  31  May,  5,  10,  15,  20,  25  June  1979.  The  pre-processing 
algorithm  linearly  interpolated  height,  wind,  and  humidity  values  on  the  97  latitude 
sets  (192  longitude  points  in  each  set)  to  96  Gaussian  latitudes  of  the  30R  GSM 
transform  grid.  The  19  levels  of  height  (Z)  at  each  of  the  192  x  96  gridpoints  were 
used  to  hydrostatically  calculate  temperature  (T),  then  perform  a  quadratic 
extrapolation  or  interpolation  between  mandatory  levels  to  obtain  the  model  terrain 
surface  pressure  (p*)  at  each  gridpoint,  based  on  model  terrain  height  (Z*).  With  p* 
thus  obtained  and  the  o  =  p/p*  specified  on  Figure  2  (N12  for  GWC84,  N18  for  GL-89 
and  PL-91),  we  computed  the  pressure  at  o-levels  and  -layers  at  each  gridpoint.  We 
then  interpolated  the  mandatory  level  values  of  horizontal  wind  (u,v),  temperature, 
and  relative  humidity  (RH)  linearly  in  the  logarithm  of  pressure  to  the  o  layers. 
After  conversion  of  RH  to  specific  humidity  (q),  T,  u,  v,  q,  p*,  and  Z*  were 
transformed  to  coefficients  of  the  spherical  harmonics  (spectral  form)  at  each  a  layer. 
The  resulting  spectral  fields  of  divergence  (D),  absolute  vorticity  (q),  T,  q,  natural 
logarithm  of  p*,  and  <$*  =  gZ*  on  o-layers  served  as  initial  conditions  for  all  of  the  PL 
GSM. 

Each  version  of  the  PL  GSM  was  integrated  using  20-minute  time  steps  out  to  10 
days  of  forecast  time.  Spectral  forecast  fields  and  accumulated  precipitation  were 
saved  at  12-hour  intervals  for  evaluation.  The  post-processing  of  the  forecast  fields 
to  the  FGGE  Ill-b  analysis  grid  proceeded  as  follows.  First,  we  performed  a 
backward  transform  from  spectral  coefficients  to  grid-point  values  (on  the  1.875°  grid) 
at  each  o-layer.  After  conversion  of  q  to  RH,  we  performed  a  linear  (in  logarithm  of 
pressure)  interpolation  of  u,  v,  T,  and  RH  from  o-layer  pressures  to  the  19  mandatory 
levels  at  each  gridpoint.  In  instances  where  mandatory  levels  lie  below  the  model 
terrain,  an  extrapolation  was  necessary.  The  o-layer  T  were  used  to  construct  o-level 
Z  (hydrostatically)  and  o-level  T  (linear  interpolation).  Then  the  o-level  Z,  T  values 
bounding  a  mandatory  level  were  used  to  quadratically  interpolate  (in  logarithm  of 
pressure)  to  obtain  Z  at  the  mandatory  level.  Finally,  mandatory  level  T  was 
calculated  from  mandatory  level  Z.  The  result  was  values  of  Z,  T,  u,  v,  RH  on  the 
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1.875°  grid  at  the  19  mandatory  levels.  These  fields  were  compared  directly  with 
verifying  FGGE  Ill-b  analyses  at  verifying  times  of  the  forecasts. 

4.  EXPERIMENTAL  RESULTS 

4.1  Direct  Comparisons  of  Forecasts  With  FGGE  Ill-b  Analyses 

In  this  report,  we  have  chosen  to  use  the  FGGE  IH-b  analyses  to  be  our  only 
reference  for  verification  of  the  prognostic  variables.  Yang  et  al.6  also  verified 
individual  forecasts  of  earlier  versions  of  the  PL  GSM  against  rawinsonde 
observations.  However,  they  found  that  inferences  from  the  statistics  of  comparison 
with  the  two  references  generally  agreed  with  each  other.  We  will  limit  our 
evaluation  to  the  use  of  the  analysis  as  a  reference.  Future  evaluations  should 
extend  the  scrutiny  to  observational  data  as  a  reference. 

4.1.1  HEMISPHERIC  STATISTICS 

We  choose  to  employ  hemispheric  statistics  as  collective  measures  of  model 
performance  as  a  natural  follow-on  to  the  decision  to  group  the  January  and  June 
cases  separately  for  seasonal  differences.  In  the  following  figures,  we  show  profiles 
and  time  series  of  the  bias  and  root-mean-square  errors  (RMSE)  for  the  six  January 
and  six  June  1979  cases.  Bias  is  defined  as  the  area-weighted  average  of  differences 
between  the  forecast  and  analysis  at  analysis  gridpoints  in  a  hemisphere  at  each 
analysis  level.  RMSE  is  the  square  root  of  the  area- weigh  ted  average  of  squares  of 
the  difference  between  the  forecast  and  analysis  et  analysis  gridpoints  in  a 
hemisphere  at  each  analysis  level.  At  each  analysis  grid  pressure  level  and  latitude 
in  the  post-processed  forecasts  and  corresponding  analyses  (both  on  the  1.875°  grid), 
we  computed  the  average  of  the  fields  (zonal  averages),  the  average  of  the  difference 
of  the  fields  (zonal  mean  error),  and  the  square  root  of  the  average  squared  difference 
of  the  fields  (zonal  RMSE).  The  area-weighted  average  of  the  zonal  statistics  over 
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each  hemisphere  are  the  hemispheric  statistics  discussed  in  this  section.  The  results 
shown  here  are  restricted  to  the  variables  T,  u,  v,  and  RH,  given  the  predicted 
variables  T,  D,  r\,  and  q  and  analysis  values  of  Z,  u,  v,  and  RH.  The  previous  section 
discussed  how  the  prognostic  variables  were  post-processed  to  the  analysis  variables. 
Analysis  values  of  T  are  derived  from  analysis  values  of  Z  hydrostatically. 

Figures  3  and  4  show  profiles  of  the  temperature  bias  and  RMSE  respectively  for 
the  Northern  Hemisphere.  Results  for  the  six  January  cases  are  shown  in  the  upper 
row,  and  for  the  six  June  cases  in  the  lower  row.  Each  data  point  on  the  profile 
corresponds  to  one  of  the  16  analysis  levels  from  1000  to  50  mb.  The  width  of  each 
individual  box  (between  successive  forecast  days)  represents  5K  in  bias  and  10K  in 
RMSE.  The  corresponding  Southern  He. ’isphere  profiles  reveal  trends  similar  to 
their  Northern  Hemisphere  season  counterparts.  Therefore,  we  show  only  the 
Northern  Hemisphere  profiles  for  the  error  trends  in  both  hemispheres.  These  plots 
illustrate  the  consistency  of  the  temperature  error  from  case  to  case  for  each  version 
of  the  model.  Because  we  found  it  difficult  to  differentiate  between  the  similar  error 
statistics  for  the  various  model  versions  in  the  wind  and  humidity,  they  were  not 
shown  in  this  format. 

We  present  Figures  5-22  in  an  attempt  to  bring  out  the  differences  among  cases 
and  contrasts  between  versions  of  the  time  evolution  of  the  hemispheric  error 
statistics.  Plots  are  shown  of  RMSE  for  u,  v  at  850,  500,  and  200  mb  (Figures  5-10), 
bias  and  RMSE  for  T  at  850,  500,  and  25H  mb  (Figures  11-16),  and  bias  and  RMSE 
for  RH  at  850,  500,  and  300  mb  (Figures  17-22).  Note  that  the  ordinate  scale  can 
vary  from  frame  to  frame,  so  care  should  be  exercised  when  comparing  various 
versions  of  the  model. 

Another  commonly  used  measure  of  forecast  accuracy  is  the  500  mb  height 
anomaly  correlation.  This  is  the  spatial  correlation  between  the  forecast/climatology 
difference  and  the  analysis/climatology  difference.  Figures  23  and  24  show  the 
results  for  the  Northern  Hemisphere  (north  of  20°N)  for  January  and  June  cases 
respectively.  The  curves  join  the  means  of  the  six  cases  for  each  model  version,  while 
a  pair  of  symbols  designates  <,ne  standard  deviation  on  each  side  of  the  group  mean 
at  a  given  day. 
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Northern  Hemisphere  Temperature  Bias  of  (a)  GWC84  January,  (b)  GL-89  January, 
(c)  PL-91  January,  (d)  GWC84  June,  (e)  GL-89  June,  and  (f)  PL-91  June. 


Figure  4.  Northern  Hemisphere  Temperature  RMSE  of  (a)  GWC84  January,  (b)  GL-89  January, 

(c)  PL-91  January,  (d)  GWC84  June,  (e)  GL-89  June,  and  (f)  PL-91  June. 


Figure  5.  Northern  Hemisphere  Wind  RMSE  of  850  mb  January  Forecasts  of  (a)  GWC84,  Zonal  Component, 

(b)  GWC84,  Meridional  Component,  (c)  GL-89,  Zonal  Component,  (d)  GL-89,  Meridional 
Component,  (e)  PL-91,  Zonal  Component,  (f)  PL-91,  Meridional  Component. 


Figure  6.  Same  as  in  Figure  $  for  500  mb. 
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ie  as  in  FUrure  5  for  June  Forecasts. 


Figure  10.  Same  as  in  Figure  7  for  June  Forecasts. 


i  iC 


Figure  1 1.  Northern  Hemisphere  Temperature  Bias,  RMSE  of  860  mb  January  Forecasts  of  (a)  GWC84,  Bias, 
(b)  GWC84,  RMSE,  (c)  GL-89,  Bias,  (d)  GL-89,  RMSE,  (e)  PL-91,  Bias,  (f)  PL-91,  RMSE. 


Figure  12.  Same  as  in  Figure  11  for  500  mb. 
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Figure  15.  Same  as  in  Figure  12  for  June  Forecasts. 


Figure  16.  Same  as  in  Figure  13  for  June  Forecasts, 
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Figure  20.  Same  as  in  Figure  17  for  June  Forecasts. 
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Figure  22.  Same  as  in  Figure  19  for  June  Forecasts, 
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ANOMALY  CORRELATION  NORTH  OF  20N 


for  June  Forecasts. 


4.1.2  ZONAL  AVERAGE  STATISTICS 


The  composition  of  the  hemispheric  error  statistics  presented  in  the  previous 
section  will  now  be  shown  by  means  of  latitude-pressure  cross  sections  of  zonally- 
averaged  error  statistics  for  u,  T,  and  RH,  in  which  we  regard  individual  cases  as  a 
random  sample  of  the  monthly  climatology.  Zonal  statistics  were  computed  for  each 
forecast  day  over  the  ensemble  of  January  cases,  and  over  the  ensemble  of  June 
cases.  Forecast  cross  sections  for  days  3,  5,  and  10  are  shown  in  Figures  25-34. 
These  plots  helped  us  in  recognizing  the  patterns  of  spatial  distribution  and  trends 
in  temporal  evolution  of  the  errors. 

The  significant  warm  bias  apparent  on  the  zonal  mean  T  cross-sections  (Figures 
29,  30)  and  resulting  large  RMSE  (Figures  31,  32)  south  of  about  65S  and  for 
pressures  greater  than  700  mb  are  an  artifact  of  the  post-processing  step.  Forecast 
data  on  sigma  layers  are  extrapolated  to  pressure  surfaces  that  in  actuality  are  below 
the  ground  surface  in  Antarctica.  The  typical  lapse  rate  in  the  region  (temperature 
decreasing  with  altitude)  in  the  sigma  layers  would  result  in  an  extrapolation  which 
yields  temperatures  much  warmer  than  those  specified  in  the  corresponding  analysis. 
Therefore,  comparisons  between  forecasts  should  be  avoided  in  this  section  of  the 
plots. 

4.1.3  HEMISPHERIC  MAP  COMPARISONS 

In  the  preceding  section,  we  presented  zonal  cross  sections  depicting  the  latitude- 
pressure  distribution  of  errors.  In  this  section,  we  take  this  analysis  a  step  further 
by  attempting  to  assess  the  three-dimensional  spatial  distribution  of  such  consistent 
errors.  To  do  this,  we  have  produced  hemispheric  maps  of  the  mean  and  standard 
deviation  of  the  forecast  errors  (computed  from  evaluation  against  FGGE  Ill-b 
analyses)  for  the  cases  in  each  month.  We  computed  these  statistics  over  the  60-,  72-, 
84-,  96-,  108-,  and  120-hour  forecasts  for  all  six  cases  in  each  month.  In  all,  36 
individual  forecasts  at  each  gridpoint  contributed  to  the  depicted  statistics.  This  was 
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Figure  25.  Latitude  -  Pressure  Distributions  of  Zonal  Bias  of  Zonal  Wind  Component 
at  Days  3,  5,  10  of  the  January  Forecasts  for  (a)  GWC84,  (b)  GL-89,  (c)  PL-91 


Figure  26.  Same  as  in  Figure  25  for  June  Forecasts. 


Figure  29.  Latitude-Pressure  Distributions  of  Zonal  Bias  of  Temperature  at  Days  3,  5,  10 

of  the  January  Forecasts  for  (a)  GWC84,  (b)  GL-89,  (c)  PL-91. 
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Figure  33.  Latitude-Pressure  Distributions  of  Zonal  Bias  of  Relative  Humidity  at  Days  3,  5,  10  of  the 

January  Forecasts  for  (a)  GWC84,  (b)  GL-89,  (c)  PL-91. 
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Figure  34.  Same  as  in  Figure  33  for  June  Forecasts. 


an  attempt  to  display  the  short-term  forecast  error  climatology.  Thus,  these 
depictions  will  display  the  geographic  distribution  of  the  errors  leading  to  the  three- 
and  five-day  zonal  mean  errors  shown  L,  Figures  25-34.  As  we  shall  see,  these  maps 
are  a  useful  tool  in  identifying  regions  of  suspected  systematic  error  for  more 
temporally  and  spatially  detailed  study. 

Because  we  want  to  focus  on  systematic  error  in  this  analysis,  we  will  only  show 
error  maps  where  the  mean  error  is  of  equal  or  greater  magnitude  than  the  standard 
deviation  of  the  error.  Here  we  present  our  results  of  the  analysis  of  the  PL-91 
version  of  the  PL  GSM.  In  all  of  the  following  maps,  we  have  indicated  with  stippling 
those  areas  where  the  isobaric  surface  depicted  by  the  map  lies  at  or  below  the 
earth’s  terrain  (resulting  from  a  comparison  of  the  mean  FGGE  Ill-b  geopotential 
heights  with  the  1.875°  latitude-longitude  terrain  heights).  This  helps  to  identify 
(and  exclude  from  discussion)  those  errors  that  may  have  resulted  from  subterranean 
extrapolation.  Indicated  latitude  and  longitude  lines  are  at  30°  intervals.  To  select 
the  maps  for  the  following  discussion,  we  evaluated  maps  of  wind  speed,  height, 
temperature,  and  relative  humidity  error  at  950,  850,  700,  500,  and  200  mb.  We 
identified  regions  of  large  bias  in  the  mean  error  maps,  then  made  sure  that  the 
standard  deviation  in  the  same  region  was  no  greater  than  the  indicated  bias. 

In  wind  speed  in  the  January  maps,  we  see  a  region  of  negative  bias  off  the  west 
coast  of  South  America  that  appears  to  be  significant  at  950  and  850  mb  (Figure  35). 
At  200  mb,  we  note  several  regions  of  systematic  positive  wind  speed  bias,  notably 
over  Saudi  Arabia,  between  Australia  and  New  Zealand,  and  over  Cuba  (Figure  36). 
In  June,  we  see  a  region  of  significant  positive  wind  speed  bias  at  850  and  700  mb 
over  northwestern  South  America  (Figure  37).  A  large  region  of  systematic  positive 
bias  exists  over  south  central  Africa  and  over  Hawaii  at  200  mb  (Figure  38).  In  all 
of  the  above  figures,  a  strong  negative  systematic  bias  is  depicted  at  the  extreme  high 
latitudes  (near  90°),  greatest  in  the  winter  hemisphere.  Its  position  and  orientation 
suggest  the  error  is  occurring  at  or  very  near  the  pole.  Subsequent  investigation 
revealed  that  the  post-processing  assigns  a  zero  value  to  the  forecast  winds  at  the 
poles,  as  the  wind  components  at  the  poles  are  ambiguous.  This  latter  error  would 
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Hemispheric  Maps  of  PL-91  60-120  Hour  January  Forecast  Error  of  Wind  Speed: 
(a)  Western  Hemisphere  (WH),  950  mb  Mean  Error  (ME),  (b)  WH,  950  mb  Standard 
Deviation  of  Error  (SDE),  (c)  WH,  850  mb  ME,  (d)  WH,  850  mb  SDE. 


Hemispheric  Maps  of  PL-91  60-120  Hour  January  Forecast  Error  of  Wind  S] 
Hemisphere  (EH),  200  mb  ME,  (b)  EH,  200  mb  SDE,  (c)  WH,  200  mb  ME  (d) 


Hemispheric  Maps  of  PL-91  60-120  Hour  June  Forecast  Error  of  Wind  Speed:  WH,  850  mb 
ME,  (b)  WH,  850  mb  SDE,  (c)  WH,  700  mb  ME,  (d)  WH,  700  mb  SDE. 
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not  have  appeared  on  the  zonal  mean  cross-sections,  which  did  not  include  data 
poleward  of  80°. 

In  view  of  the  hydrostatic  relationship,  we  will  show  only  the  temperature  errors 
to  represent  systematic  errors  in  the  predicted  mass  field.  In  January,  we  see 
systematic  positive  temperature  errors  over  north-central  Siberia,  southeastern 
China,  Kamchatka  and  offshore,  south-central  Europe,  and  the  Mississippi  River 
basin  in  the  United  States  at  950  mb  (Figure  39).  Also  at  950  mb,  we  see  a  band  of 
significant  cold  bias  extending  almost  the  entire  length  of  South  America,  much  of 
which  appears  to  lie  just  east  of  the  Andes  Mountains.  The  warm  biases  over 
Europe,  Siberia,  and  Kamchatka  and  offshore  extend  up  to  850  mb  (Figure  40), 
whereas  a  strong  region  of  cold  bias  appears  at  850  mb  on  the  Canadian-Alaskan 
border,  while  the  cold  bias  persists  east  of  the  Andes  up  to  850  mb.  At  200  mb 
(Figure  41),  a  large  swath  of  significant  warm  bias  occurs  south  of  Australia, 
bordered  on  its  south  by  an  equally  strong  region  of  cold  bias.  Another  patch  of  cold 
systematic  bias  lies  to  the  west,  with  a  somewhat  smaller  cold  error  region  off 
southwestern  Alaska.  In  June,  systematic  positive  temperature  forecast  errors  occur 
at  950  mb  (Figure  42)  over  northeastern  Europe,  northwestern  Africa,  the  Amazon 
basin,  and  are  widespread  over  northern  Canada.  Significant  negative  temperature 
errors  occur  over  India  northward  to  the  Himalayas,  the  Suez  and  Persian  Gulfs, 
southeast  of  the  Caspian  and  Aral  Seas,  northwestern  South  America,  and  along 
much  of  the  coastline  of  Antarctica,  especially  in  the  region  of  the  International 
Dateline.  At  850  mb,  a  large  systematic  positive  bias  is  spread  over  southern  Africa, 
while  at  700  mb,  a  somewhat  lesser  positive  anomaly  lies  south  of  the  Caspian  Sea 
(Figure  43).  At  500  mb  (Figure  44),  a  significant  warm  bias  (where  the  mean  is  alK 
greater  than  the  standard  deviation)  occurs  over  eastern  Siberia,  and  also 
overspreads  much  of  the  low  latitudes,  especially  over  northern  Africa,  Europe,  the 
Middle  East,  India,  and  the  equatorial  central  Pacific.  The  zonal  cross  sections  for 
relative  humidity  mean  error  (Figures  33,  34)  pointed  to  a  tendency  of  the  PL-91 
model  to  develop  and  sustain  a  dry  bias  at  low  levels  (centered  at  900  mb  and  largest 
in  the  tropics),  a  moist  bias  at  700  mb  in  the  tropics  (dry  at  high  latitudes),  a  dry 
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Figure  39.  Hemispheric  Maps  of  PL-91  60-120  Hour  January  Forecast  Error  of  Temperature:  (a)  WH,  950 
mb  ME,  (b)  WH,  950  mb  SDE,  (c)  EH,  950  mb  ME,  (d)  EH,  950  mb  SDE. 


850  mb. 


Figure  41.  Same  as  in  Figure  39  for  200  mb. 
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bias  again  at  400  mb,  and  a  moist  bias  at  and  above  300  mb.  The  error  maps  for 
relative  humidity  (not  shown)  show  that  these  errors  are  not  concentrated  in  certain 
locales  as  are  temperature  and  winds,  but  are  widespread  on  each  isobaric  surface. 
In  almost  all  instances,  the  standard  deviation  of  the  error  is  greater  than  the  mean. 

We  also  drew  maps  of  mean  and  standard  deviation  of  the  forecast  error  of  mean 
sea  level  pressure  (not  shown).  With  only  two  localized  exceptions,  the  mean  error 
was  less  than  the  standard  deviation  in  areas  away  from  high  terrain.  There  were 
no  signs  of  a  systematic  loss  or  gain  of  mass  in  localized  areas.  In  January,  the 
standard  deviation  of  the  error  (highest  in  the  midlatitudes)  was  nearly  the  same  in 
both  Northern  and  Southern  Hemispheres,  However,  in  June  the  standard  deviation 
of  the  mean  sea  level  pressure  error  in  the  Southern  Hemisphere  is  more  than  twice 
that  of  the  Northern  Hemisphere,  and  is  somewhat  greater  than  that  of  the  January 
Northern  Hemisphere. 

4.1.4  REGIONAL  STATISTICS 

We  now  focus  our  attention  on  two  limited  regions.  We  calculated  the  error 
statistics  for  GWC84,  GL-89,  and  PL-91  over  two  limited  regions,  the  central  Pacific 
Ocean  and  North  America.  The  two  study  "windows"  are  shown  in  Figure  45.  The 
regions  were  chosen  for  their  geographic  diversity  so  that  much  could  be  learned 
about  model  performance  by  considering  two  differing  climatic  regions. 

For  the  measures  of  performance  on  an  isobaric  surface,  we  employ  mean  error 
(bias)  and  root-mean-square  error  (RMSE)  over  each  window.  Both  the  mean  errors 
and  RMSEs  are  the  weighted  averages  of  individual  gridpoint  values.  However,  in 
the  calculation  of  the  correlation  coefficient  between  a  model  simulation  and  the 
corresponding  analysis,  all  grid  points  in  a  window  are  weighted  equally.  This  was 
done  to  better  represent  the  degree  of  similitude  seen  on  the  maps  of  distribution 
where  no  account  was  given  of  max  factor.  The  statistics  are  calculated  and 
displayed  separately  for  each  individual  case.  Figures  46  and  47  depict  the  bias  and 
RMSE  of  temperature  for  the  central  Pacific  window,  and  Figures  48  and  49  display 
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Figure  46.  Central  Pacific  Temperature  Bias  of  January  and  June  Forecasts  of  (a)  850  mb, 
(b)  700  mb,  (c)  500  mb,  and  (d)  300  mb. 


Figure  46.  Central  Pacific  Temperature  Bias  of  January  and  June  Forecasts  of  (a)  850  mb, 
(b)  700  mb,  (c)  500  mb,  and  (d)  300  mb. 


Figure  47.  Same  as  in  Figure  46  for  RMSE. 


Figure  48.  Same  as  in  Figure  48  for  North  American  Window. 
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Figure  48.  Same  as  In  Figure  46  for  North  American  Window. 


Figure  49.  Same  as  in  Figure  48  for  RMSE 


the  same  for  the  North  American  window.  In  these  figures,  the  following  associations 
apply:  EXP  G  =  GWC84,  EXP  1  =  GL-89,  and  EXP  2  =  PL-91.  Figure  50  shows  values 
of  the  correlation  coefficients  for  the  temperature  forecasts.  Plots  for  the  bias  of 
relative  humidity  are  shown  in  Figures  51  and  52.  RMSE  for  relative  humidity 
quickly  degrades  to  levels  greater  than  30%  for  all  model  versions  and  are  not  shown. 

4.2  Evaluation  of  Forecasts  in  the  Planetary  Boundary  Layer 

4.2.1  REGIONAL  COMPARISONS  WITH  FGGE  Ill-b  ANALYSES 

In  this  section,  we  consider  the  impact  of  the  two  most  recent  enhancements  to 
the  planetary  boundary  layer  (PBL)  parameterization  in  the  PL  GSM.  As  seen  in 
Table  1,  the  PL-91  model  added  spatially  varying  soil  and  vegetation  type  descriptors 
and  a  gravity  wave  drag  parameterization.  Since  these  additions  are  likely  to  have 
an  impact  in  the  low  levels  of  the  model,  we  focus  on  the  90  kPa  (900  mb)  isobaric 
surface  for  this  discussion.  In  addition,  we  compare  the  impact  on  the  temperature 
field  ir.  two  versions  of  the  PL  GSM  that  will  isolate  the  soil-vegetation  and  gravity 
wave  drag  effects.  RAD-0  is  a  model  version  very  much  like  GL-89  but  using  only  a 
clear-sky  (no  clouds)  radiation.  PBL-2G  is  RAD-0  but  with  the  new  soil-vegetation 
and  gravity  wave  drag  effects  included.  Figures  53  and  54  show  the  forecast-analysis 
temperature  difference  between  these  two  versions  for  two  days  of  a  single  January 
case  over  North  America. 

4.2.2  PERFORMANCE  OF  THE  PBL  PREDICTIONS  AT  MODEL  GRIDPOINTS 

The  PL-91  predictions  and  the  FGGE  Ill-b  analyses  were  processed  in  such  a  way 
ar  to  facilitate  comparison  on  the  model’s  Gaussian  grid  at  several  locations.  The 
process  was  carried  out  as  follows.  The  analyses  for  all  six  January  and  June  PL-91 
cases  were  transformed  from  30  rhomboidal  spectral  form  to  the  model’s  Gaussian 
grid  (96  equally  spaced  longitude  points  at  3.75°  longitude,  76  Gaussian  latitudes  at 
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Figure  50.  Spatial  Correlation  of  Temperature  and  Geopotential  Height  Forecasts 
with  FGGE  IEI-b  Analyses  for  North  American  (NA)  and  Central  Pacific 
(CP)  Windows  at  850, 500,  and  300  mb:  (a)-(c)  January,  and  (d)-(f)  June. 
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Figure  50.  Spatial  Correlation  of  Temperature  and  Geopotential  Height  Forecasts 
with  FGGE  Ill-b  Analyses  for  North  American  (NA)  and  Central  Pacific 
(CP)  Windows  at  850, 500,  and  300  mb:  (a)-(c)  January,  and  (d)-(f)  June. 
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Figure  50.  Spatial  Correlation  of  Temperature  and  Geopotential  Height  Forecasts 
with  FGGE  IEI-b  Analyses  for  North  American  (NA)  and  Central  Pacific 
(CP)  Windows  at  850, 500,  and  300  mb:  (a)-(c)  January,  and  (d)-(f)  June. 
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Figure  50.  Spatial  Correlation  of  Temperature  and  Geopotential  Height  Forecasts 
with  FGGE  Ill-b  Analyses  for  North  American  (NA)  and  Central  Pacific 
(CP)  Windows  at  850, 500,  and  300  mb:  (a)-(c)  January,  and  (d)-(f)  June. 
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Figure  50.  Spatial  Correlation  of  Temperature  and  Geopotential  Height  Forecasts 
with  FGGE  Ill-b  Analyses  for  North  American  (NA)  and  Central  Pacific 
(CP)  Windows  at  850, 500,  and  300  mb:  (a)-(c)  January,  and  (d)-(f)  June. 
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Figure  50.  Spatial  Correlation  of  Temperature  and  Geopotential  Height  Forecasts 
with  FGGE  113-b  Analyses  for  North  American  (NA)  and  Central  Pacific 
(CP)  Windows  at  850, 500,  and  300  mb:  (e)-(c)  January,  and  (d)-(f)  June. 
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Figure  51.  Central  Pacific  Relative  Humidity  Bias  of  January  and  June  Forecasts 
at  (a)  850  mb,  (b)  700  mb,  (c)  500  mb,  and  (d)  300  mb. 


Figure  52.  Same  as  in  Figure  51  for  North  American  Window. 


Figure  52.  Same  as  in  Figure  51  for  North  American  Window. 


Figure  53.  Map  of  Forecast  -  Analysis  Temperature  Differences  at  900  mb  for 
24-Hour  Forecasts  Valid  1200  UTC  13  January  1979:  (a)  RAD-O,  and  (b)  PBL-2G. 
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Figure  54.  Same  as  in  Figure  S3  for  48-Hour  Forecast  Valid  1200  UTC 
14  January  1979. 


approximately  2.35°  latitude),  but  were  left  on  the  model’s  sigma  layers.  The  FGGE 
Ill-b  analysis  corresponding  to  each  forecast  was  pre-processed  to  the  30  rhomboidal 
truncation  on  the  model  sigma  layers,  using  the  same  procedure  used  in  constructing 
the  forecast  initial  conditions  (that  is,  using  the  PL-91  silhouette  orography).  Then 
the  analyses  were  post-processed  to  the  Gaussian  grid  but  left  on  sigma  layers  as  was 
done  for  the  forecasts.  This  process  was  carried  out  to  ensure  that  the  same  spatial 
scales  and  same  vertical  interpolations  were  applied  to  both  forecast  and  verification 
fields.  We  chose  five  Gaussian  gridpoints,  each  of  which  is  located  near  a  weather 
(radiosonde)  station  to  compare  PL-91  forecasts  with  verifying  analyses.  The  five 
gridpoints  were  chosen  for  their  geographic  diversity  and  the  fact  that  the  analysis 
at  each  point  is  supported  by  nearby  radiosonde  data.  Table  2  lists  the  five  Gaussian 
gridpoints  chosen  for  this  study,  along  with  their  terrain  height,  and  the  height  of  the 
nearby  RAOB  station.  In  all  cases,  the  Gaussian  gridpoint  closest  to  the  station, 
whose  latitude  and  longitude  are  given  in  Table  2,  was  chosen  as  the  location  of  the 
comparison.  Thus,  the  geographic  locations  referred  to  in  the  following  figures 
actually  correspond  to  the  Gaussian  gridpoint. 


Table  2.  Geographical  Location  of  the  Five  Giidpoints  the  Evaluation  of 

PBL  Prediction. 


Gridpoint 

Number 

Latitude 

Longitude 

Z. 

m 

h  (m) 

The  nearest 
Station 

Z.  -  h 

m 

Local  Time 
at  12UTC 

1 

38.82N 

105.00  W 

2698 

1625 
'  Denver 

1073 

5  am 

2 

41.18N 

97.50  W 

582 

406 

Omaha 

176 

6  am 

3 

20.00N 

153.75  W 

223 

11 

Hawaii 

212 

2  am 

4 

83.52N 

63.75  W 

753 

63 

Alert 

690 

8  am 

5 

88.20S 

0.00 

2986 

2835 

Amundsen 

151 

12  noon 

Z.  =  silhouette  topography  model  surface  height;  h  =  nearby  RAOB  station  elevation. 


84 


Figures  55-72  show  the  tin .9  series  of  forecasts  and  analyses  for  a  single  model 
layer  in  the  boundary  layer  for  ail  six  January  and  June  cases.  Temperature,  specific 
humidity,  wind  speed,  and  wind  direction  in  the  model  layer  closest  in  pressure  to  the 
nearest  radiosonde  report  level  are  shown  for  Denver  (Figures  55-60),  Hawaii 
(Figures  61-66),  and  Alert  (Figures  67-72).  Choosing  this  layer  for  verification 
ensures  that  the  analysis  is  supported  by  nearby  (in  the  vertical)  radiosondr  lata. 
We  show  these  plots  to  show  the  time  evolution  of  the  boundary  layer  forecast 
performance  of  PL-91  in  a  variety  cf  weather  conditions  and  representative 
geographic  locations. 

4.3  Patterns  of  Weather  Prediction 

This  section  features  a  set  of  maps  that  compare  PL-91  and  GWC84  forecasts  with 
verifying  FGGE  Ill-b  analyses.  Software  was  developed  to  produce  color-filled 
animations27  of  side-by-side  forecast  and  verification  maps  at  6h  intervals  out  to  10 
days.  As  expected,  these  animations  show  a  steady  phase  and  amplitude  error 
growth  in  the  forecasts  with  time.  They  provide  a  unique  opportunity  to  look  for 
trends  in  the  way  a  prediction  may  systematically  depart  from  the  verification.  This 
information  may  aid  in  improving  the  model  by  suggesting  specific  areas  of 
investigation  of  the  model  design. 

Figures  73-81  are  black-and-white  "snapshots"  of  the  animation  sequence  for  PL- 
91  and  GWC84.  In  Figures  73-75,  we  show  72-hour  forecasts  of  mean  sea  level 
pressure  (pmsl),  500  mb  height,  850  mb  relative  and  specific  humidities,  300  mb 
relative  humidity,  and  200  mb  wind  speed  for  the  12  January  case  over  most  of  the 
Northern  Hemisphere  (down  to  22. 5N).  Figures  76-81  show  pmsl,  wind  vectors 
(alternate  gridpoints  plotted  at  850  mb),  specific  humidity  at  850  mb,  and  relative 


'  Norquist,  D.  (1992)  "Everybody  talks  about  the  weather,  but...”,  Vector  View,  5,  March-April  1992, 
)->  pp  [Available  from  Phillips  Laboratory  Supercomputer  Center,  PL'SCI,  Kirtland  AFB,  NM  87117- 
G008] 
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Figure  55.  Time  Series  of  o  =  0.960  FGGE  Ill-b  (Solid  and  PL-91  (Dash)  Temperature 

(C)  at  Gridpoint  Near  Denver  for  Six  January  Cases  (Abscissa  is  Integer 
Number  of  12-Hour  Intervals  in  10-Day  Forecast). 
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Figure  56.  Same  as  in  Figure  55  for  June  Cases. 
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Figure  57.  Same  as  in  Figure  55  for  Specific  Humidity  (g/kg). 
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Figure  58.  Same  as  in  Figure  57  for  June  Cases. 
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Figure  59.  Time  Series  of  o  =  0.960  FGGE  Ill-b  (Solid)  and  PL-91  (Dash)  (a)  Wind  Speed 
(m/s)  and  (b)  Wind  Direction  (degrees)  at  Gridpoint  Near  Denver  for  Six  January  Cases. 
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Figure  60.  Same  as  in  Figure  59  for  June  Cases. 
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Figure  63.  Same  as  in  Figure  61  for  Specific  Humidity  (g/i kg). 
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Figure  64.  Same  as  in  Figure  63  for  June  Cases. 
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Figure  65.  Time  Series  of  a  =  0.995  FGGE  Ill-b  (Solid)  and  PL-91  (Dash)  (a)  Wind  Speed 
(m/s),  and  (b)  Wind  Direction  (Degrees)  at  Gridpoint  Near  Hawaii  for  Six  January  Cases. 
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Figure  65.  Time  Series  of  o  =  0.995  FGGE  Ill-b  (Solid)  and  PL-91  (Dash)  (a)  Wind  Speed 
(m/s),  and  (b)  Wind  Direction  (Degrees)  at  Gridpoint  Near  Hawaii  for  Six  January  Cases. 
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Figure  66.  Same  as  in  Figure  65  for  June  Cases. 

100 


s  i  gma  =  0 . 995 

F39(aalid1.  PL-91  (daahl  .  Ha.  41 1  05/31/79  F39leolid>.  PL-91(daeM.  Ha.ail  06/05/79 

140 


MB 

BBMBBM 

MMM 

mm 

Mi 

mb 

BM 

mbbm^b^b 

HI 

BH 

MB 

MMMM 

MMM 

BM  ^M 

Mi 

^M 

MB 

BM 

mmhm 

BB 

iHi 

Mi 

MMMM 

MMM 

MM 

MB 

Mi 

Mi 

Ml 

MMMM 

IB 

MB 

MB 

MB  MB  BM  Ml 

MMM 

MM 

^M 

BM 

BM 

Mi 

MMMM 

bb 

HH 

^M 

MMMM 

MMM 

BM 

MB 

BM 

MB 

BB 

MMMM 

BB 

BH 

mM 

BBBMMM 

MMM 

BM  ^M 

BB 

BM 

M 

mb 

MMMM 

bb 

^M 

^M 

.BB  MB  Mb  MB 

MMM 

BM  Mi 

BM 

BM 

MB 

BM 

MBBM^MIMi 

^M 

— 

f 

IBMUIB 

^H  BM  MB 

BM  IH 

BB 

Hi 

MB 

^M 

mb^bbhbb 

Mi 

BM 

BM 

BVMMM 

MMM 

MM 

MB 

MB 

BM 

^M 

MMBB3 

^B 

s 

B1PBIBM 

lii 

5 

KB 

H 

HI 

B.inSM 

BC 

s 

s 

s 

BIB1MM 

rj 

s 

s 

SSS'a 

■■S 

«s 

5 

M? 

rm 

MS 

,M=S- 

HH 

■a 

MB  MB  MB  Mi 

^H  BM  BM 

MMIM 

BB 

BU 

MB 

^B 

MMMM 

BB 

■Bi 

BM 

Ml  BM  BM  ^M 

^H^H^H 

BM  ^M 

i^B 

MB 

BB 

^M 

MMMM 

^B 

BM 

UB 

MB  BM  BB  MB 

MMM 

^B^B 

MB 

MB 

MB 

^M 

MMMM 

bb 

MB 

am 

MMMM 

MB  MB  BM 

MB  BM 

^M 

Mi 

mb 

BM 

MMMM 

MB 

MB 

MB  MB  MB  BM 

MMM 

BM  BB 

^B 

MB 

MB 

HI 

BB  iM  Hi  ^B 

BM 

BM 

BM 

MMMM 

MB^H^H 

BM 

^H 

BM 

^B 

^M 

MBiM^M^B 

BB 

MB 

MB 

MMMM 

MMM 

^M  BM 

BM 

^M 

BB 

^M 

MMMM 

BM 

BM 

^M 

MMMM 

MB  ^H  Mi 

BM  Mi 

MB 

BM 

BM 

Mi 

MB  MB  BM  MB 

Ml 

■■ 

MB Mi BM MB 

■■ 

Hi 

■  BBB 

Mi 

BM 

BB' 

MB  MB  MB' 

HI 

MMM 

MB 

MB 

MB  BB  BM 

HI 

BM  MB  BB 

hm 

mb 

^B 

BM 

BB  MB  MB 

BB 

BM  Hi  ^M 

hm 

j^B 

BB 

MB 

MMM 

^B 

BB  MB  HI 

BH  BM 

BB 

BB 

MB 

MB  BM  BM 

BM 

HHM 

BM  BB 

wm 

BB 

BM  MM  BM 

BM 

hhh 

^m^b 

H 

BM 

BB 

BM  BM  BM 

^B 

MHHMMBJhBM 

HHM 

MB  IH 

BM 

IH 

BHBM  BB 

Hi 

hmk 

^H 

BM 

MB 

BBMBBM 

MB 

BMBBr^B 

hm 

■■ 

i^B 

BM 

BB  MM  Hi 

BB 

WiMI 

Min 

iH 

BM 

'MB 

MMM 

tm 

BlBa  mi  ^WM  MB  ^i^i  MB  BE 

MMM 

BPQV 

H". 

BM 

BB 

BPC1M!^7 

zjm 

hmm 

WM 

I^B 

IBM 

Mr/CB 

BC* 

BB  BB  MB 

mb 

rm 

BB 

BM 

■B'JBM 

Hi 

HMM 

MB  iM 

iH 

BB 

MMM 

BB 

HHM 

hm 

■B 

BM 

BM 

MB  BM  BM 

BM 

MMM 

BB^B 

BB 

BM 

BM  MB  MB 

BM 

MMM 

hm 

HI 

BB 

BB 

HHiH 

Mi 

HHH 

mm^b 

BB 

BB 

BM 

MMM 

^B 

BBMBBM 

MB  HI 

BB 

Hi 

BM 

BM  MB  HI 

^M 

MMM 

hm 

I^B 

MB 

MM 

MMM 

^M 

HHM 

bm^b 

BM 

BB 

MB 

MHIHHH 

BB 

HMM 

HI  iH 

hb 

^B 

BM 

BBMB  BB 

BM 

hmm 

Hi  MB 

IH 

BM 

MMM 

iM 

HHH 

MM 

tm 

No.  of  13  hour  freak 

F30I..U4I,  PL-91  (daaHI.  Ha.ail  06/30/79 


HM 

MB 

MB 

Hi 

HHH1 

HI. 

MBBM 

■Hi 

MM 

BH 

HB 

hh 

BBBHI 

BM 

BM 

BB 

HBBBHi 

HI 

Hi  MB 

HI 

^HBH 

^H 

BH 

^H  BH 

Ml  Ml 

BBBM 

BB 

^H 

BB 

HMM 

Hr 

BB 

Mi  Hi 

HH 

BH 

Hi  BM 

Hi  BH 

MM 

BB 

BH 

HR 

BB  MB  HI 

HI 

^H^H 

^B 

BH  IH 

BH 

BH 

BB  Hi 

IM  MB 

MBBB 

BM 

BH 

BB 

BMHHBR 

bb 

BB  IM 

BH 

MMMM 

^H 

BB 

hh 

Hi  Hi 

BMBB 

BB 

BH 

PH 

H9CM 

HB 

IH  ^H 

H 

hh 

^H 

BH 

bm^m 

BBBM 

MM 

BM 

BB 

i^B  Mi  MM 

BM 

BB  BH 

MB 

BBMB 

HB 

I^H 

hh 

^H  HI 

HH 

^M 

BB 

rm 

iB  HB  BB 

^H 

mm 

Hi 

HB  BM 

MB 

IH 

Hi  Hi 

BMBB 

HH 

BM 

m 

BB 

IB  MUM 

mb 

bm  tm 

Hi 

MB^H 

BM 

MB 

MEM  MR 

MM 

Hi^B 

HB 

MB 

BB 

Ml  HH 

BH 

him 

Hi 

kH^H 

MM 

M W* 

WBBM 

wm  BB 

l^MBEit^B 

wm 

BM 

H'^BHB 

mt 

MB  Hi 

wm 

HM 

^H 

WM 

iMfiB 

'^H 

BH 

iH  Mi  HI 

hi 

JM 

BiK 

•SB 

rm 

HB^H 

HH 

BHi'H 

BB 

BH 

^B 

HBK'BBB 

Hi 

BIM 

Hi 

M4B 

BB 

iH 

iH  BB 

HIBH 

MM 

BH 

BB 

IH 

BBBMMM 

Hi 

VMH 

BH 

BH  BH 

MU 

HB 

hm 

hh 

5S 

5 

* 

MB 

35S 

■i 

ISS 

* 

MM 

M 

M 

MM 

MM 

hh 

BH 

tm 

HI 

hh 

M 

hm 

M 

IH  iH 

BM 

BM 

HB 

MH  Mi  Hi 

BM 

MM  Ml 

HI 

hm 

Hi 

BB 

HHiH 

HIBH 

MB^M 

BB 

BB 

BM 

HHH 

Hi 

HI  MM 

MB 

HBHH 

BB 

HB 

BB  MM 

BMBB 

MM 

^B 

BM 

MB 

BM^BMH 

Hi 

Hi  Hi 

^H 

HH 

BH 

im 

bb^m 

BBMB 

^B^B 

IH 

'MB 

BH 

HMH 

BB 

BB  BB 

Hi 

HB  M 

^H 

MM 

BH  ^H 

HI  HB 

BBBH 

'BB 

'BM 

BB 

MHM 

BM 

MliH 

HI 

^H^H 

BH 

BM 

mbhb 

MB  MM 

Hi  BH 

IBM 

BB 

BM 

BBMBBM 

BM 

mm  hi 

^H 

^M^B 

HH 

BH 

BM  ^M 

BIBB 

'iH 

BHM 

MM 

MM 

M 

MM 

BB 

BB 

MM 

MM 

r  i  i  i  r  t~ 

MM 

hhh 

MM^B 

’ill 

HH 

MBHiBB 

Hi^B^B 

hhhm 

BB  BB 

hmm 

BM  MB  M 

hhhm 

1 

hmhhhm 

BBiH 

mbbbbb 

MMM 

HI  HIBH  Mil  BBBH 

HI  BB 

HHM 

HIHB^H 

MHHM 

BMBB  HI  Hi  BBBM 

^H^H 

hhh 

HHH 

HHHM 

HMHMM  BB 

BB  BM 

HHH 

Ml  Hi  IH 

hhhm 

HHHBHEMBMiUH 

HI  Ml 

MB  Hi  HI 

MBHIBB 

BB  Ml  BMBB 

HNMMIMMII 

MJM 

HHH 

MMM 

MMHM 

MUCl 

HMUBHIiBI. 

HIB 

sss 

SSS 

MMMM 

hwhmlbm 

HMD 

HBiM 

he  pm  be 

HU 

MIBM 

^BCB^ 

BPTl 

■  l'BMMl 

ss 

MM 

HMH 

hhhm 

iH  I^B  Hi  IM  ^B  iH 

HH 

BB^BMH 

BBMI^H 

MHHH 

HMHHHM 

BBBM 

HHH 

MMM 

MMMM 

HMMHHH 

HH 

HMM 

HHH 

MMMM 

MMMMMM 

MH 

HB  MB  BH 

HHH 

BMIMiBH^B 

HMHHHM 

■H  I^B 

HHBBBB 

BB^H^H 

hhhm 

MMHMMM 

BBMB 

hhh 

HHH 

hmmm 

Hi  MB 

HMM 

HH  BB  HB 

hhhm 

MM 

BMBMBB 

HMM 

hhhh 

i  t  i  t  r  i- 

. J—  i 

111- 

3  4  *  8  10  13  14  16  10  30 

No.  of  13  How.  freak  * 

F38(aol id) ,  PL-91 (daahl .  Ha.ail  06/10/79 


0  3  4  6  0  10  13  14  16  10  20 

No.  of  12  hour  freak 

F39(aal tdl ,  PL-91  Idaehl  .  Ha.ail  06/15/79 


mm 

BHM 

BH 

MB  HI 

Hi 

HM 

BB 

^H  ^B 

IH 

MV^B 

Hi 

MM 

BM 

IH^M 

BM 

Hi  BB 

^M 

BH 

MB 

BBBB 

Hi 

Wt.  BH 

Hi 

BBMB 

BH 

rjH 

BH 

BBBB 

BM 

BH 

BBBM 

^M 

^H^B 

MB 

HH 

^B.  HI  BH  HB  BH  BB  B3 

MB 

MM 

MB 

m 

MUAIHBMM 

^M 

BB^H 

▼1 

B.aB 

Hi 

MH 

UK 

BM 

MIBB 

fBH 

BH  HB  Hi  kl  ^B  IH  Mi 

^M 

IH  BH 

BB 

BBBH 

BH 

Ml  Mi 

■H 

MBBB 

Mi 

iH  HH 

HB 

BM^H 

BB 

HI  ^M 

BH 

HH 

Mi 

HB  BB 

■H 

HI  BH 

HB 

HB  HB 

MB 

BMBB 

BB 

HM 

HB 

Mi  iH 

HB 

Hi  HB 

^H 

HH 

HB 

BH^H 

BH 

BMBB 

Mi 

BH  MB 

Hi 

BBBB 

M 

—  M 

■■ 

BBMB 

No.  of  12  hour  freak 

F30(aelidl.  PL-91 (daahl .  Ha.ail  06/35/79 


6  0  10  13  14  16  10  30 

Na .  af  12  heyr  free! 


F 

— 

— 

— 

= 

=FFF 

a 

a=F 

— 

■■ 

HI  ^H 

^B 

hmmm 

^H 

IH  BB  Ml 

IH 

BH  BB  HB  Hi 

^M 

HB  MB  Hi 

^M 

MM  BM  MBBB 

HI  MM  HI 

MMMM 

MB 

hhh 

HM 

HiBBi^BflM 

HB 

bbmmhh 

^m^m 

cz 

mmmh 

HI 

hmm 

^BIH 

■■■ 

,  " 

3B 

MRJHH 

^B 

Ml  MB  MB 

V.CB 

vBBBM 

wm 

mmhm 

BB 

HI  BH  MC 

K7iBB. 

H 1 

■■■ 

wm 

ABM 

VIB 

^H 

ilBU’M 

iM 

MHM 

ViH 

Am 

BB 

HrtTL 

6.1 

MMMmZ 

MBBBBB 

fBH 

ih  mm 

l  '  ' 

MMMM 

_M 

mb  eh  ih 

hmmm 

BB 

^mwmwd 

— 

— 

_ 

_ 

■■■■ 

B* 

tmmwmi 

_ 

d 

— 

— 

- 

— 

MH 

Hi 

HHH 

— 

— J 

hmmm 

IZ 

MIHI^B 

|H  HB  BM  MB 

HI 

Hi  BH  BB 

■bmhh 

HHM 

hb  ih  hh  hb 

^H 

HB  BH  BH 

Hi  MBBBBB 

MB 

Hi  BMBB 

hhhm 

^H 

hhh 

L— 

L 

- 

_ 

III 

_ 

_ 

6  0  10  12  14 

Na .  af  12  hawr  freat 


Figure  66.  Same  as  in  Figure  65  for  June  Cases. 
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Figure  67.  Time  Series  of  o  =  0.960  FGGE  Ill-b  (Solid)  and  PL-91  (Dash)  Temperature  (C) 
at  Gridpoint  Near  Alert  for  Six  January  Cases. 
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Figure  69.  Same  as  in  Figure  67  for  Specific  Humidity  (g/kg). 
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Figure  70.  Same  as  in  Figure  69  for  June  Cases. 
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Figure  71.  Time  Series  of  o  =  0.960  FGGE  Ill-b  (Solid)  and  PL-91  (Dash)  (a)  Wind  Speed 
<m  's),  and  (b)  Wind  Direction  (degrees)  at  Gridpoint  Near  Alert  for  Six  January  Cases. 
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Figure  71.  Time  Series  of  a  =  0.960  FGGE  Ill-b  (Solid)  and  PL-91  (Dash)  (a)  Wind  Speed 
(m/s),  and  (b)  Wind  Direction  (degrees)  at  Gridpoint  Near  Alert  for  Six  January  Cases. 
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Figure  72.  Same  as  in  Figure  71  for  June  Cases. 
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74.  Northern  Hemisphere  (a)  850  mb  Relative  Humidity  (Contour  Interval  =  20%)  and  (b)  850  mb  Specific 
ity  (Contour  Interval  =  2  g/kg)  for  72  Hour  GWC84  and  PL-91  1200  UTC  12  January  1979  Forecasts,  and 
ng  FGGE  Hl-b  Analysis. 


Verifying  FGGE  Ill-b  Analysis. 


Figure  75.  Northern  Hemisphere  (a)  300  mb  Relative  Humidity  (Contour  Interval  =  20%)  and  (b)  200  mb  Wind  Speed 
(Contour  Interval  =  10  rajs)  for  72  Hour  GWC84  and  PL-91 1200  UTC  12  January  1979  Forecasts,  and  Verifying  FGGE 
IH-b  Analysis. 


Figure  75.  Northern  Hemisphere  (a)  300  mb  Relative  Humidity  (Contour  Interval  =  20%)  and  (b)  200  mb  Wind  Speed 
(Contour  Interval  =  10  m/s  for  72  Hour  GWC84  and  PL-91 1200  UTC  12  January  1979  Forecasts,  and  Verifying  FGGE 
m-b  Analysis. 
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Figure  76.  Eastern  Hemisphere  Tropical  (30S  to  30N)  Mean  Sea  Level  Pressure 
(Contour  Interval  =  4  mb)  for  72-Hour  GWC84  and  PL-91  1200  UTC 
10  June  1979  Forecasts  and  Verifying  FGGE  Ill-b  Analysis. 


Figure  77.  Same  as  in  Figure  76  for  850  mb  Wind. 
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Figure  79.  Same  as  in  Figure  76  for  850  mb  Relative  Humidity 
(Contour  Interval  =  20%). 
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Figure  81.  Same  as  in  Figure  79  for  400  mb. 
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humidity  at  850,  700,  and  400  mb  over  the  tropical  (30N-30S)  Eastern  Hemisphere. 
The  relative  humidity  fields  (both  forecast  and  analysis)  were  smoothed  before  they 
were  plotted. 

An  advantage,  of  the  color-filled  version  of  the  figures  is  that  they  allow 
quantitative  comparisons  to  be  made  much  more  readily  than  the  black-and-white 
contours.  This  is  especially  true  of  fields  like  mean  sea  level  pressure,  where  one 
must  count  the  contour  lines  to  compare  amplitudes  of  the  features.  Even  so,  the 
referenced  black-and-white  figures  show  clearly  that  by  72  hours  of  forecast  time, 
both  versions  of  the  PL  GSM  have  departed  from  the  analyzed  fields  in  both  phase 
and  amplitude.  We  have  not  yet  conducted  an  exhaustive  study  of  the  animations  to 
determine  forecast  error  trends  for  the  PL  GSM  versions;  however,  a  brief  discussion 
of  what  we  have  noticed  from  the  12  January  1979  1200  UTC  forecasts  is  included 
in  Section  5. 

4.4  Forecast  Precipitation,  Evaporation,  and  Cloud  Results 

The  three  versions  of  the  PL  GSM  (GWC84,  GL-89,  PL-91)  simulate  precipitation 
and  evaporation  of  water  from  the  surface  (GWC84  evaporates  over  oceans  only).  All 
three  versions  share  the  same  large-scale  (stratiform)  precipitation  parameterization 
scheme;  however,  as  shown  in  Table  1,  they  have  quite  different  convective 
parameterization  schemes.  As  we  shall  see,  different  convective  parameterizations 
can  have  differing  impacts  on  the  performance  of  the  stratiform  parameterization 
scheme  (as  well  as  on  other  parameterizations  in  the  model). 

The  results  discussed  below  were  developed  in  the  following  manner.  The  global 
average  precipitation  and  evaporation  rates  for  all  of  the  six  cases  were  averaged  to 
produce  the  January  and  June  ensemble  means.  For  the  accumulated  precipitation 
amounts,  we  summed  Days  2-6  accumulations  over  the  six  cases  to  arrive  at  the 
monthly  accumulation  for  each  model  Gaussian  gridpoint.  Day  1  precipitation  was 
not  used  in  order  to  allow  the  model  to  adjust  to  the  initial  state.  The  six  five-day 
accumulations  represent  all  of  the  precipitation  the  model  produced  for  the  periods 
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3  January  1979  1200  UTC  -  2  February  1979  1200  UTC  (January  accumulation)  and 
1  June  1979  1200  UTC  -  1  July  1979  1200  UTC  (June  accumulation). 

Table  3  displays  the  global  average  precipitation  and  evaporation  rates  (in 
mm/day)  during  Days  2-6  of  the  January  and  June  cases.  The  evaporation  rates  for 
GWC84  were  not  saved,  but  should  be  much  lower  than  the  corresponding  rates  for 
GL-89  and  PL-91  since  GWC84  considered  evaporation  only  over  the  oceans. 

Table  3.  Global  Average  Precipitation  and  Evaporation  Rates  (mm/day) 


January 

June 

GWC84 

GL-89 

PL-91 

GWC84  GL-89 

PL-91 

Total  Precipitation 

1.07 

2.88 

3.15 

1.08  3.14 

3.36 

Convective  Precipitation 

0.10 

1.17 

2.05 

0.10  1.46 

2.30 

Evaporation 

2.98 

3.33 

3.08 

3.43 

The  global  average  total  (stratiform  plus  convective)  precipitation  rates  may  be 
compared  with  the  climatological  values  computed  by  Jaeger28  of  2.56  mm/day  for 
January  and  2.97  mm/day  for  June.  Averaged  over  the  two  seasons,  the  stratiform 
precipitation  accounts  for  90,  55,  and  33  percent  of  the  total  for  GWC84,  GL-89,  and 
PL-91,  respectively.  Evaporation  rates  are  in  approximate  balance  with  precipitation 
rates  over  the  five-day  forecast  periods  in  January  and  June  for  both  GL-89  and  PL- 
91.  Figure  82  shows  the  global  average  total  precipitation  and  evaporation  rates  for 
the  January  and  June  cases  as  a  function  of  forecast  time.  The  diurnal  signal  in  the 
GL-89  and  PL-91  curves  result  from  the  bulk  of  the  precipitation  being  concentrated 
at  certain  longitudes  in  the  tropics.  A  "spin-up"  of  precipitation  is  apparent  in 
GWC84  and  GL-89,  while  a  "spin-down"  occurs  in  the  PL-91  experiments.  The 
approximate  precipitation-evaporation  balance  in  GL-89  and  PL-91  occurs  by  the  end 
of  Day  2. 


28.Ja eger,  L.  (1983)  Monthly  and  areal  patterns  of  mean  global  precipitation,  in  Variations  in  the 
Global  Water  Budget,  A.  Street-Perrott,  M.  Beran,  R.  RatclifTe,  Eds.,  D.  Reidel,  Dordrecht. 
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Figure  82.  Global  Average  (a)  and  (b)  Precipitation  Hate  (mm/day)  and  (c)  and  (d)  Evaporation  Rate  (mm/day) 
Averaged  over  Six  January  [(a)  and  (c)J  and  June  [(b)  and  (d)J  Forecasts. 


Figure  83  depicts  the  meridional  cross-sections  of  the  monthly  accumulation  in 
January  and  June  for  the  three  versions  of  the  model.  For  reference,  the 
climatological  values  from  Jaeger28  are  also  plotted.  Figures  84  and  85  show  the 
geographic  distributions  of  the  accumulated  precipitation  for  all  three  model  versions 
in  January  and  June,  respectively.  As  was  shown  in  Norquist  and  Yang,12  the  GL-89 
version  produces  the  tropical  maxima  in  the  locations  indicated  by  precipitation 
climatology  and  outgoing  longwave  radiation  (OLR)  observations.  PL-91  produces 
maxima  in  approximately  the  same  locations  but  with  somewhat  greater  amounts. 
PL-91  also  produces  what  appears  to  be  excessive  maxima  in  certain  regions  of  the 
winter  hemisphere  side  of  the  equator  (which  are  also  apparent  in  the  zonal  means 
in  Figure  83). 

The  PL-91  version  of  PL  GSM  includes  a  cloud  parameterization  scheme  based 
on  that  of  Slingo29.  Schattel15  has  described  its  formulation  and  its  performance 
based  on  the  January  experiments.  The  Slingo  scheme  was  modified  to  yield  more 
realistic  cloud  amounts  in  PL-91.  In  particular,  the  original  Slingo  scheme  with  its 
cirrus  anvil  formulation  was  generating  too  much  high  cloud.  This  feature  was 
removed,  and  the  critical  relative  humidity  (the  threshold  above  which  cloudiness  is 
inferred)  was  made  to  increase  linearly  from  80  to  100  percent  with  decreasing  o 
through  the  high  cloud  deck.  We  made  this  modification  to  reduce  the  excessive  high 
cloudiness  found  in  PL-91  resulting  from  the  version’s  tendency  to  be  overly  moist  in 
the  high  cloud  deck.  We  also  set  the  top  of  the  high  clouds  to  o  =  0.2  in  the  tropics 
to  help  alleviate  this  problem,  as  we  noted  many  instances  of  saturation  or  near- 
saturation  above  o  =  0.2  due  to  this  same  moisture  build-up.  However,  this 
limitation  probably  imposed  a  cap  too  low  in  altitude  on  tropical  convection  as 
suggested  by  OLR  results  presented  by  Schattel.16  As  can  be  seen  in  Figure  86,  PL- 
91  still  produces  an  abundance  of  high  cloud  at  most  latitudes  when  compared  to  the 


29Slingo,  J.  (1987)  The  Development  and  Verification  of  a  Cloud  Prediction  Scheme  for  the  ECMWF 
Model,  Quart.  J.  Roy.  Meteor.  Soc.,  113:899-927. 
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Figure  84.  Global  Maps  of  Accumulated  Total  Precipitation  (mm)  Over  Days  2*6  of 
Six  January  Forecasts  for  (a)  GWC84,  (b)  GL-89,  and  (c)  PL-91  (Contour  Interval  = 
150  mm). 
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Figure  86.  Zonal  Time  Average  of  Cloud  Amounts  From  (a)  Three  10-Day  January 
1979  PL-91  Forecasts,  and  (b)  Climatology  Based  on  January  1979  3DNEPH  Data 
[from  Schattel16]. 
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cloud  climatology.  Furthermore,  the  model  appears  to  produce  too  little  low  cloud, 
particularly  in  the  tropics.  Since  the  stratiform  cloud  formulation  is  based 
primarily  on  relative  humidity,  these  results  are  seen  to  agree  with  the  results 
presented  in  Figure  33. 

5.  ANALYSIS  AND  CONCLUSIONS 

In  this  section,  we  present  our  analysis  of  and  the  resulting  conclusions  from  the 
experimental  results  presented  in  Section  4.  In  view  of  the  limited  number  of 
samples  we  have  dealt  with,  the  conclusions  should  be  taken  as  preliminary.  In  some 
cases,  we  choose  to  speculate  as  to  the  cause  of  a  certain  error  characteristic  of  some 
version  of  the  PL  GSM.  These  speculations  should  be  considered  only  as  suggested 
causes. 

Figures  3  and  4  were  selected  for  illustration  for  a  number  of  reasons.  First  of 
all,  we  consider  temperature  to  be  the  single  most  important  and  the  best  predicted 
prognostic  variable.  Secondly,  bias  and  root-mean-square-error  (RMSE)  are  the  direct 
global  measures  of  the  two  most  important  attributes  of  a  forecast  model,  namely,  the 
systematic  error  and  the  collective  accuracy  of  forecast. 

It  also  turned  out  that  the  error  statistics  of  temperature  were  more  coherent 
spatially  and  more  consistent  not  only  from  case  to  case  but  also  from  one  hemisphere 
to  the  other  and  from  January  to  June,  than  other  prognostic  variables  studied,  as 
we  saw  in  later  Figures.  This  convinced  us  that  whatever  differences  are  found  in 
these  error  statistics  among  various  versions  are  indeed  due  to  the  differences  in 
physical  parameterizations  and  not  some  fortuitous  or  unspecified  external  influences. 
Likewise,  any  similarity  between  these  error  statistics  for  a  particular  case  leads  us 
to  conclude  that  the  statistic  is  insensitive  to  the  differences  between  various 
versions. 

It  is,  then,  immediately  obvious  from  Figure  3  that  GWC84  becomes  warmer, 
while  GL-89  becomes  cooler,  in  the  middle  troposphere,  as  time  goes  on.  To  be  sure, 
the  growth  rates  are  greater  in  both  versions  in  the  January  cases  than  in  the  June 
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cases,  but  the  warming  in  GWC84  is  greater  than  the  cooling  in  GL-89  in  both 
seasons.  On  the  other  hand,  both  versions  show  excessive  warming  in  the  top  layers 
above  tropopause  in  both  seasons.  Here,  however,  while  GL-89  shows  a  greater 
warming  than  GWC84  in  January,  the  opposite  is  true  in  June. 

In  PL-91  we  find  a  mid-tropospheric  warming  whose  magnitude  is  about  the  same 
as  that  of  cooling  in  GL-89  in  January,  but  much  greater  in  June.  The  warming  of 
PL-91  occurs  in  both  seasons  in  the  top  layers,  but  the  seasonal  contrast  is  less. 

While  the  forms  of  vertical  profiles  change  because  of  changes  in  magnitude  at 
individual  levels,  these  same  individual  trends  of  either  warming  or  cooling  are  also 
found  in  the  Southern  Hemisphere.  We  conclude,  therefore,  from  Figure  3  that  the 
principal  effects  of  the  differences  among  the  versions  are  confined  to  the  troposphere 
and  that  the  warming  in  the  stratosphere  arises  mainly  from  the  common  feature  in 
these  versions. 

To  see  how  these  hemispheric  biases  are  made  up,  we  next  turn  to  the 
corresponding  zonal  statistics  as  depicted  in  Figures  25-34  that  show  the  latitude- 
pressure  cross  sections  between  80  S  and  80  N  on  days  3,  5,  and  10  of  the  three 
model  versions,  averaged  over  all  six  cases  in  each  season.  We  Find  in  GWC84  that 
the  warming  is  taking  place  universally  except  for  two  isolated  small  regions,  one  in 
the  tropical  boundary-layer  region  and  the  other  in  the  arctic  stratosphere  above  200 
mb,  where  cooling  also  intensifies  with  time.  It  is  clear  that  the  warming  is  most 
intense  in  the  high  middle  latitudes  in  the  winter  hemisphere  and  the  least  in  the 
equatorial  troposphere. 

In  GL-89,  on  the  other  hand,  we  Find  that  the  low-latitude  troposphere  is  totally 
dominated  by  cooling  whose  centers  appear  in  the  lower  layers  but  above  the 
boundary-layer  region.  The  warming  in  the  middle  and  high  latitudes  is  greatly 
reduced  both  in  intensity  and  in  coverage.  As  to  PL-91,  we  find  that  warming  in  the 
middle  and  high  latitudes  is  similar  to  GL-89  in  both  intensity  and  coverage,  but  the 
cooling  in  the  low-latitude  troposphere  in  GL-89  is  replaced  by  weak  cooling  in  the 
equatorial  lower  troposphere.  In  particular,  the  maximum  warming  at  500  mb 
observed  in  both  seasons  in  the  hemispheric  statistics  is  very  well  accounted  for  by 
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the  distributions  in  these  cross-sections.  Finally,  the  warm  bias  in  the  stratosphere, 
found  to  be  common  to  all  versions  in  both  seasons,  is  seen  in  these  cross-sections  to 
sit  right  above  the  Equator  and  extend  more  or  less  equally  into  both  hemispheres. 

We  next  examine  Figure  4,  which  depicts  the  evolutions  of  forecast  accuracies. 
In  both  seasons  both  GL-89  and  PL-91  yield  smaller  values  of  RMSE  than  GWC84 
throughout  the  whole  depth  of  the  troposphere.  The  largest  reduction  is  found  in  the 
bottom  layers  in  January  and  in  the  middle  troposphere  in  June.  The  difference 
between  GL-89  and  PL-91  is  more  subtle;  the  magnitude  is  smaller  than  that  of 
either  from  GWC84  and  varies  not  only  from  case  to  case  but  also  from  level  to  level. 

The  distributions  of  the  ensemble  averages  of  the  corresponding  zonal  statistics 
are  depicted  in  Figures  25-34.  It  is  evident  that  in  all  versions,  values  of  RMSE  are 
smallest  in  the  equatorial  region  and  increase  toward  the  centers  in  high  latitudes. 
We  find  major  contributions  toward  reducing  the  hemispheric  RMSE  in  GL-89  and 
PL-91  come  from  two  sources:  extension  of  coverage  by  smallest  RMSE  in  the 
equatorial  region  and  decrease  in  the  value  of  the  maximum  RMSE  in  the  high- 
latitude  centers. 

To  bring  out  more  detail  in  the  error  statistics,  we  have  chosen  to  employ  a 
different  presentation,  as  shown  in  Figures  5-22.  In  each  of  these  figures,  each  frame 
depicts  the  time  variations  of  one  of  the  error  statistics  for  individual  cases  for  one 
of  the  three  versions  at  one  of  three  pressure  levels,  representing  the  low,  middle  and 
high  troposphere,  respectively.  The  corresponding  distributions  of  zonal  statistics  are 
presented  in  Figures  25-34. 

In  wind  speeds,  we  show  only  RMSE  (Figures  5-10),  since  in  all  cases  magnitudes 
and  variations  of  biases  are  so  much  smaller  than  those  of  RMSE  (see,  for  example, 
Figures  25-28)  that  we  consider  them  to  be  of  little  value  for  the  purpose  of 
comparison.  Three  features  may  be  noted  in  these  figures,  where  u  is  shown  on  top 
and  v  at  bottom.  First,  RMSEs  in  the  two  wind  components  are  nearly  equal  at  all 
times.  Secondly,  the  RMSEs  increase  with  elevation  as  mean  winds  do  in  all 
versions.  Finally,  there  is  little  difference  among  the  three  versions,  with  a  sole 
exception  at  200  mb  where  GWC84  clearly  yields  larger  values.  It  is  apparent  that 
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there  is  little  discernible  effect  on  the  wind  speed  errors  produced  by  the  differences 
among  the  three  versions.  The  corresponding  cross-sections,  Figures  27  and  28,  show 
uniformly  that  the  centers  of  maximum  RMSE  are  located  in  the  cores  of  jet  streams 
and  confirm  the  conventional  notion  that  the  greater  the  wind  speed,  the  greater  the 
error  in  wind  speed. 

In  relative  humidity,  we  present  bias  at  the  top  and  RMSE  at  the  bottom  in  each 
figure  (Figures  17-22).  Here,  we  find  wide  variations  and  large  differences  from  level 
to  level  and  from  version  to  version  in  bias,  but  a  great  uniformity  among  cases  and 
small  differences  among  versions  in  RMSE.  Gradual  diying  in  the  low  and  middle 
tropospheres  of  GWC84  and  steady  moistening  in  middle  and  upper  tropospheres  of 
GL-89  are  evidently  consistent  from  case  to  case.  On  the  other  hand,  the  dryness 
found  in  the  low  troposphere  of  PL-91  and  in  the  upper  troposphere  of  GWC84  is 
more  of  a  static  than  evolutionary  nature.  Apparent  fluctuations  and  variabilities 
observed  in  biases  are  the  result  of  magnified  scales  employed  to  emphasize 
differences  among  cases.  Aside  from  the  trends  of  bias  noted  above,  these  figures 
show  that  GL-89  produces  the  largest  RMSE  and  GWC84  and  PL-91  are  nearly  equal 
in  the  middle  and  high  tropospheres.  In  the  lower  troposphere,  however,  GWC84  and 
PL-91  are  comparable  and  produce  smaller  RMSEs  than  GL-89. 

By  comparing  values  of  RMSE  in  wind,  temperature,  and  relative  humidity  and 
adapting  a  simple  rule  of  selecting  a  version  or  versions  with  the  smallest  RMSE,  in 
which  a  small  margin  is  allowed  for  equivalence,  we  attempted  to  score  relative 
merits  of  the  three  versions  with  respect  to  each  variable  and  each  layer.  The  result 
is  summarized  in  Table  4,  where  "X"  denotes  a  version  or  versions  deemed  best.  It 
should  be  added  here  that  all  forecasts  in  a  10-day  period  were  weighted  equally  in 
comparing  RMSE  values  over  the  entire  period.  Regarding  all  the  variables  and  two 
seasons  equally,  we  would  then  find  PL-91  to  have  the  greatest  number  of  "Xs"  and 
thus  be  considered  the  most  desirable  version  of  all. 
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Table  4.  A  Score  Card  on  Northern  Hemisphere  Error  Statistics 


GWC84 

GL-89 

PL-91 

L  M  H 

L  M  H 

L  M  H 

January 

V 

X 

X 

X  X 

T 

X  X 

XXX 

RH 

X 

X 

X  X 

June 

V 

X 

X 

X 

T 

X 

X  X 

RH 

X 

X  X 

Turning  to  Figures  23  and  24,  which  present  the  time  variations  of  the  500  mb 
height  anomaly  correlation,  we  find  that  all  three  versions  show  skill  up  to  Day  6  in 
the  Northern  Hemisphere  and  that  there  is  no  statistically  significant  difference 
among  them  before  Day  6  in  both  seasons.  It  is  also  noted  that  PL-91  yields  the 
highest  correlation,  with  substantial  difference  from  the  others  beyond  Day  6  in  both 
seasons.  Although  not  shown  in  figures  here,  we  also  found  from  the  results  that  all 
versions  showed  poorer  skill  in  the  other  two  zones  (up  to  Day  4)  and  that  the 
equatorial  zone  showed  larger  differences  and  wider  variations  among  different 
versions  than  the  higher  latitude  zones. 

In  Section  4.1.3,  we  presented  hemispheric  maps  depicting  the  geographical 
distributions  of  systematic  errors  of  the  PL-91  forecast  model.  Generally,  the  results 
show  that  although  areas  of  systematic  wind  speed  forecast  errors  do  occur,  they  are 
geographically  diverse  and  are  of  modest  magnitude.  This  appears  to  be  consistent 
with  the  systematic  temperature  errors,  in  conformity  with  the  thermal  wind  relation. 
The  latter  are  seen  to  be  geographically  confined  and  not  arranged  in  definite 
geographic  patterns.  However,  we  do  notice  a  pattern  of  predominance  of  near- 
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surface  systematic  temperature  errors  occurring  over  land  surfaces,  and  most  of  these 
are  wintertime  warm  biases  in  the  Northern  Hemisphere  mid-latitudes.  In  the 
summer  season,  warm  and  cold  biases  appear  at  low  levels  over  a  number  of  land 
surfaces  with  no  clear  geographic  pattern.  Only  at  500  mb  in  the  June  forecasts, 
where  a  significant  warm  bias  covers  much  of  the  low  latitudes,  is  there  a  well 
defined  location  for  the  temperature  errors.  In  contrast,  the  widespread  nature  of  the 
relative  humidity  biases  suggest  a  tendency  to  take  moisture  from  certain  levels  of 
the  model  atmosphere  and  deposit  it  at  other  levels.  No  similar  model  tendency  to 
redistribute  momentum  or  heat  (with  the  exception  of  500  mb  in  June  in  the  tropics) 
to  certain  model  levels  was  observed. 

We  next  study  the  figures  described  in  Section  4.1.4  for  the  implications.  Figure 
46  presents  the  time  history  of  temperature  error  biases  in  the  Central  Pacific 
window  at  850,  700,  500,  and  300  mb  levels  of  the  three  model  versions  in  all  12 
cases  of  the  experiment.  Figure  48  does  the  same  for  the  North  American  window. 
We  find  two  notable  features  that  are  common  to  all  panels  in  both  figures.  The  first 
is  that  GL-89  is  most  negatively  or,  equivalently  least  positively,  biased  of  the  three 
versions.  The  other  is  that  PL-91  remains  in  parallel  with  and  positively  biased  from 
GL-89.  Both  support  very  well  the  findings  of  the  hemispheric  statistics  for  the 
window-sized  regions  shown  in  Figure  3.  On  the  other  ^and,  while  GWC84  also  is 
consistently  biased  positively  from  GL-89,  its  difference  from  either  GL-89  or  PL- 91 
is  less  uniform  among  cases  and  across  levels.  As  a  result,  correspondence  of  the 
difference  between  GWC84  and  GL-89  or  PL-91  between  regional  and  hemispheric 
statistics  is  less  obvious  than  that  of  the  difference  between  GL-89  and  PL-91. 

We  attribute  this  contrast  in  the  differences  of  temperature  error  biases  to  the 
difference  in  degree  of  change  between,  say,  pair  GWC84  and  GL-89  and  pair  GL-89 
and  PL-91.  For  example,  it  is  evident  from  Table  1  that  there  have  been  more 
substantial  modifications  introduced  between  GWC84  and  GL-89  than  between  GL-89 
and  PL-91.  We  think,  furthermore,  that  the  ubiquitous  and  uniform  nature  of  the 
difference  between  GL-89  and  PL-91  reflects  directly  the  changes  made  from  GL-89 
to  PL-91;  that  is  the  radiation  and  moist  convection  schemes.  In  contrast,  the  less 
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well-defined  difference  of  either  GL-89  or  PL-91  from  GWC84  represents  a 
complicated  synthesis  of  effects  from  many  more  components  of  change  brought  into 
the  newer  versions. 

In  considering  the  difference  between  GWC84  and  GL-89,  we  see  in  Figures  82 
and  83,  that  there  is  in  the  amount  of  rainfall  a  4  to  1  ratio  in  the  CP  window  and 
2  to  1  ratio  in  the  NA  window  between  GL-89  and  GWC84.  In  spite  of  these 
additional  sources  of  latent  heat  for  wanning  the  middle  troposphere  in  both  windows 
and  in  both  seasons,  GL-89  is  considerably  cooler  and  gets  colder  with  time  than 
GWC84  throughout  the  troposphere.  We  believe  the  main  cause  of  the  difference  is 
the  University  of  Utah’s  1-deck  (high-cloud)  radiation  scheme  introduced  in  GL-89. 
The  scheme  reduces  the  amount  of  solar  radiation  reaching  below  the  high  cloud. 
The  larger  difference  found  in  the  NA  window  in  January  is  most  likely  due  to  a 
greater  cloudiness  in  the  middle  latitudes  in  winter. 

With  regards  to  the  difference  between  GL-89  and  PL-91,  we  observe  in  Figure 
83  that  the  change  from  MODKUO  to  the  ECMWF’s  mass-flux  scheme  in  moist 
convection  parameterization  results  in  greater  (10-20  percent)  convective  precipitation 
confined  in  the  equatorial  region,  but  nowhere  else.  The  increase  in  the  global  total 
(Figure  82)  is  nearly  equal  in  the  two  seasons  (0.9  mm/day).  The  additional  source 
of  latent  heat  from  the  increased  precipitation  contributes  toward  the  warm  bias  of 
PL-91  relative  to  GL-89  in  the  CP  window.  Tiedtke10  showed  that  the  mass-flux 
convective  scheme  produced  somewhat  excessive  midtropospheric  heating  and  drying 
in  a  simulation  over  the  Marshall  Islands.  However,  the  main  source  of  the 
difference  between  PL-91  and  GL-89,  which  remains  relatively  constant  among  levels 
and  indifferent  to  season,  is  the  change  in  the  radiation  scheme  from  the  1-deck  to 
3-deck  algorithm  (see  Table  1). 

In  Figures  47  and  49  we  find  the  time  history  of  accuracies  of  temperature 
forecasts  as  measured  by  the  regional  RMSEs  for  the  three  model  versions 
represented  in  the  same  fashion  as  in  Figures  46  and  48.  The  corresponding 
hemispheric  statistics  in  a  different  format  are  shown  in  Figures  11  and  12.  The 
most  obvious  feature  common  to  both  figures  is  that  RMSE  is  greater  by  a  factor 
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ranging  from  2  to  4  in  the  NA  window  than  in  the  CP  window  at  all  levels  and  in  all 
cases,  but  the  RMSEs  in  the  various  versions  are  not  so  different  between  the  two 
windows.  We  also  readily  concede  that,  unlike  Figures  46  and  48,  it  is  hard  to 
discern  consistency  across  cases  and  levels  of  relative  orientations  of  the  three 
versions.  Both  factors  make  it  difficult  to  judge  the  relative  merit  of  the  three 
versions  on  the  basis  of  RMSE.  When  we  use  a  similar  strategy  as  the  one  used  in 
creating  Table  4  for  abstracting  the  results  shown  in  these  figures,  we  obtain  Table 
5.  The  table  makes  obvious  some  of  the  features  implied  in  the  figures,  such  as  poor 
performance  of  GL-89  in  the  lower  levels  in  the  CP  window,  but  not  in  the  NA 
window,  and  unsound  performance  of  PL-91  at  the  500  mb  level  in  both  windows 
which  was  also  evident  in  Figure  4.  It  also  shows  that  "benefits"  from  the  new 
parameterizations  are  clearly  evident  in  the  NA  window  at  all  levels,  but  are  more 
confined  to  the  upper  troposphere  in  the  CP  window. 

Table  5.  Number  of  Cases  Where  a  Version  is  Selected  as  Best  Temperature  Forecast 


Another  measure  of  accuracy  of  model  simulation  is  provided  by  the  correlation 
coefficient  between  a  simulation  and  the  corresponding  analysis.  Figure  50  presents 
the  time  variations  of  such  coefficients  of  the  three  models  in  the  two  windows  on 
each  of  three  levels,  850,  500,  and  300  mb,  in  each  of  the  12  cases  for  temperature 
(top)  and  height  (bottom)  on  the  surfaces.  They  illustrate  the  difference  in  the  way 
in  which  correlation  coefficient  and  RMSE  measure  accuracy.  We  recall  how  much 
greater  the  RMSEs  and  their  differences  among  the  models  were  in  the  NA  window 
than  in  the  CP  window.  In  contrast,  the  correlation  coefficients  and  their  differences 
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among  the  models  show  greater  ranges  of  variability  in  the  CP  window.  There  is 
hardly  any  indication  here  of  unsoundness  in  PL-91  at  the  500  mb  level  in  the  CP 
window,  nor  any  s'ign  of  poor  performances  by  GL-89  at  the  850  mb  level. 
Furthermore,  even  a  cursory  survey  of  the  figures  reveals  that  PL-91  surpasses  the 
other  two  on  all  levels  and  in  both  windows.  This,  indeed,  is  what  happens  when  one 
introduces  a  more  quantitative  way  of  scoring  individual  cases. 

We  also  studied  errors  in  other  variables  such  as  relative  humidity  and  horizontal 
wind  speeds  in  these  windows.  We  were  particularly  interested  in  knowing  whether 
a  "better"  forecast--as  measured  by  these  statistics--in  one  variable  is  necessarily 
better  in  another.  We  have  found,  on  the  basis  of  this  experiment,  that  there  is  no 
unequivocal  answer  within  the  bound  of  the  experiment.  We  illustrate  the  point  by 
presenting  Figures  51  and  52  that  show  the  time  history  of  the  regional  error  biases 
in  relative  humidity  for  the  CP  and  NA  windows,  respectively.  They  correspond  to 
Figures  46  and  48  for  temperature. 

Gridpoint -based  evaluations  of  PL-91  performance  further  detailed  errors  depicted 
on  hemispheric  maps.  We  selected  five  gridpoints  in  geographically  diverse  locations 
that  were  closely  supported  by  radiosonde  data  in  the  analysis  for  this  evaluation. 
Furthermore,  we  focused  on  the  three  lowest  model  layers  to  represent  PL-91 
boundary  layer  performance,  and  chose  the  layer  closest  to  an  observational  report 
level  to  present  as  the  verification  in  Figures  55-72.  For  the  gridpoint  1  (Denver),  for 
example,  the  average  pressures  corresponding  to  those  o  levels  were  728  mb,  718  mb, 
and  703  mb,  respectively,  as  seen  in  Table  6.  Therefore,  the  time  series  from  the 
FGGE  Ill-b  analysis  at  those  three  layers  were  actually  interpolated  from  the  same 
two  analysis  pressure  levels,  that  is,  700  and  800  mb.  Consequently,  the  time  series 
at  o  =  0.960  are  presented  in  Figures  55  through  60  because  of  their  proximity  to  700 
mb.  In  Figures  55-72,  we  denote  forecast  time  in  units  of  12-hour  forecast  intervals, 
where  in  each  case  a  forecast  was  begun  at  1200  UTC. 
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Table  6.  Height  and  Pressure  Data  for  the  Five  Reference  Gridpoints 


0 

=  1 

o  =  0.995 

a  =  0.981 

a  =  0.960 

Gridpoint  No. 
(nearest  station) 

Z*(m) 

p.(mb) 

h(m) 

p(mb) 

h(m)  p(mb) 

h(m) 

p(mb) 

1 

(Denver) 

2698 

732 

41 

728 

152 

718 

327 

703 

2 

(Omaha) 

582 

947 

42 

943 

155 

929 

333 

910 

3 

(Hawaii) 

223 

990 

44 

985 

162 

972 

349 

951 

4 

(Alert) 

753 

918 

38 

914 

140 

V 

304 

882 

5 

(Amundsen) 

2986 

668 

35 

665 

132 

656 

285 

642 

p.  =  mean  model  surface  pressure  at  model  surface  height  Z;  h  =  height  above  Z  and  p  =  pressure  for 
lowest  three  o  layers 


One  of  the  significant  features  in  the  time  series  of  temperature  (Figures  55  and 
56)  is  the  warm  bias  at  Denver.  This  feature  is  an  example  of  the  positive  mean 
errors  of  temperature  (T)  in  the  lower  atmosphere  over  the  western  United  States 
(Figure  40).  Another  significant  feature  is  the  obvious  diurnal  variation  in  June.  The 
temperatures  at  0500  local  time  (1200  UTC)  were  generally  lower  than  the 
temperatures  at  1700  local  time  (0000  UTC).  The  analyzed  temperatures  had  a 
diurnal  oscillation  with  smaller  amplitudes  than  the  predictions.  The  temperatures 
at  1700  local  time  at  Denver  were  probably  not  the  daily  maximum  temperatures. 
The  actual  amplitudes  of  diurnal  oscillations  for  both  analyzed  and  predicted 
temperature  may  be  larger  than  those  indicated  in  Figure  56.  When  we  plotted  the 
Denver  radiosonde  surface  temperatures  against  the  PL-91  a  =  0.995  temperatures, 
we  found  that  the  diurnal  amplitudes  were  indeed  larger  than  shown  here  at  o  = 
r' .960,  and  agreed  quite  well,  especially  in  June.  Finally,  we  note  that  in  most  cases 


the  PL-91  forecasts  fail  to  represent  many  of  the  longer  term  (presumably  synoptic- 
scale)  warming  and  cooling  episodes  evident  in  the  analysis.  The  forecasts  project 
persistence  of  average  conditions  resulting  in  the  greatest  warm  or  cold  biases  during 
warming  and  cooling  episodes. 

Figures  57  and  58  illustrate  the  time  series  of  specific  humidity  (q)  for  Denver. 
The  model  prediction  was  generally  too  moist  in  January  and  too  dry  in  most  of  the 
June  cases.  Figures  59  and  60  give  the  time  series  of  windspeed  (V)  and  wind 
direction  (WD)  for  Denver.  They  indicate  that  there  is  little  resemblance  between 
predicted  and  analyzed  wind  speeds  and  directions.  The  model  appears  to  be  unable 
to  replicate  the  synoptic-scale  variations  present  in  the  analyses.  As  expected,  we 
note  that  agreement  with  analyzed  wind  direction  is  best  when  analyzed  and 
predicted  wind  speeds  are  greatest,  and  are  poorest  at  low  wind  speeds.  We  observe 
that  the  mean  error  map  of  the  wind  speed  at  700  mb  (Figure  37)  also  did  not  reveal 
any  systematic  error  over  this  region. 

The  time  series  of  T,  q,  V,  and  WD  for  Hawaii  are  presented  in  Figures  61-66. 
The  model  generated  a  warm  bias  as  shown  in  Figures  61  and  62.  There  was  hardly 
any  diurnal  signal  in  the  prediction,  in  contrast  to  the  clearly  evident  signal  in  the 
analysis.  This  may  be  due  to  the  island  heating  effect  that  the  observation 
contributed  to  the  analysis,  whereas  the  prediction  gridpoint  was  treated  as  an  ocean 
point  (where  sea  surface  temperature  is  held  constant).  In  Figures  63  and  64,  we 
note  that  PL-91  fails  to  capture  the  major  synoptic-scale  drying  and  moistening 
episodes  evident  in  the  analysis,  while  correctly  predicting  the  climatological  mean 
state.  Figures  65  and  66  suggest  a  positive  wind  speed  bias  in  June.  Notice  that 
there  are  corresponding  areas  of  positive  temperature  errors  (Figures  39  and  42)  and 
positive  wind  speed  errors  (Fig  .  37)  around  Hawaii  in  those  maps.  Hence,  we 

believe  that  the  gridpoint  time  series  reveals  temporal  detail  of  the  global  model’s 
performance  at  a  particular  location. 

Figures  67-72  serve  as  another  example  of  PL-91  performance,  depicting  a 
gridpoint  near  Alert.  Temperature  is  better  predicted  in  June  than  in  January  as 
judged  by  these  cases.  The  specific  humidity  predictions  tend  to  be  too  dry  in 
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January  and  too  moist  in  June  (Figure  69  and  70).  We  should  be  careful,  however, 
to  evaluate  the  humidity  predictions  in  polar  regions  since  humidity  measurements 
are  considered  suspect  at  low  temperatures.  In  January,  the  model  often  predicted 
a  high  wind  speed  episode  that  was  not  evident  in  the  analysis  time  series  (Figures 
71  and  72).  However,  no  clear  systematic  wind  forecast  error  is  evident  from  the  12 
cases  shown  in  these  figures. 

A  point  of  qualification  is  in  order  in  the  Denver  and  Alert  verifications.  As 
previously  mentioned,  we  interpolated  the  FGGE  Ill-b  analysis  to  the  model  sigma 
structure  dictated  by  the  silhouette  topography  to  arrive  at  the  curves  referred  to  as 
"F3B"  in  Figures  55-72.  As  seen  in  Table  6,  this  means  that  for  Denver,  the  700  mb 
and  800  mb  analysis  levels  were  used  to  interpolate  values  of  T,  u,  v,  and  q  to  the 
pressure  level  corresponding  to  a  =  0.960,  nominally  about  703  mb.  According  to 
Table  6,  the  a  =  0.960  level  is  327  m  (29  mb)  above  the  model  terrain  surface  (a  =  1), 
yet  the  700  mb  radiosonde  report  level  (which  we  found  to  have  a  major  influence  on 
the  700  mb  analysis  value  at  the  gridpoint,  which  in  turn  played  the  major  role  in  the 
interpolation  to  a  =  0.960)  is  about  130  mb  above  the  actual  surface  (surface  elevation 
=  1625  m,  roughly  830  mb).  Thus,  we  are  effectively  comparing  a  forecast  value 
about  30  mb  above  the  model  surface  with  a  verification  based  on  an  observation 
about  130  mb  above  the  actual  ground  surface.  The  latter  is  probably  above  the 
boundary  layer,  most  certainly  so  in  January.  Since  the  pressure  about  30  mb  above 
the  actual  surface  is  about  800  mb,  we  plotted  the  temperature  time  series  of  the 
Denver  radiosonde  at  700  and  800  mb  to  see  how  close  these  values  are  to  the  "F3B" 
and  "PL-91"  curves  in  Figure  55.  The  700  mb  radiosonde  time  series  closely  matched 
the  "F3B"  curve,  and  the  800  mb  radiosonde  time  series  was  much  closer  to  the  "PL- 
91"  curve  than  was  the  "F3B"  curve.  We  conclude  from  this  that  proximity  of  an 
atmospheric  level  to  the  ground  greatly  influences  the  values  of  boundary  layer 
temperature.  This  may  be  true  for  moisture  and  wind  as  well.  Similarly  at  Alert, 
the  o  =  0.960  level  at  304  m  (36  mb)  above  the  model  terrain,  contrasted  with  a 
radiosonde  report  level  at  850  mb  (closest  level  to  882  mb),  some  150  mb  above  the 
actual  ground  surface  (surface  elevation  =  63  m,  roughly  1005  mb).  In  this  case,  the 
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pressure  some  35  mb  above  the  actual  surface  is  about  970  mb.  Though  we  did  not 
look  at  the  Alert  radiosonde  time  series  as  we  did  at  Denver,  we  suppose  that  the 
resulting  values  would  show  less  of  a  difference  with  respect  to  PL-91  values  than  do 
the  "F3B"  curves  shown  in  Figures  66-72.  At  Hawaii,  the  differential  between  model 
and  actual  terrain  was  not  substantial,  so  the  terrain  proximity  factor  was  not  an 
issue.  However,  this  problem  points  out  the  difficulty  of  trying  to  use  conventional 
observations  (or  analyses  based  on  those  observations)  to  verify  boundary  layer 
forecast  values.  It  appears  that,  in  the  boundary  layer,  height  (or  pressure)  above  the 
respective  ground  surfaces  should  be  used  as  the  independent  variable  in 
verifications. 

From  the  PL-91  performance  at  those  gridpoints  as  discussed  above,  several 
points  can  be  emphasized  as  a  summary  of  this  sub-section. 

a.  PL-91  produced  a  systematic  warm  bias  in  both  seasons  at  Hawaii,  and  failed 
to  depict  temperature  change  episodes  at  Denver. 

b.  PL-91  appeared  to  reproduce  correctly  the  phase  of  diurnal  temperature 
variations,  but  with  too  small  of  amplitude  over  the  ocean  (Hawaii). 

c.  PL-91  produced  seasonal  specific  humidity  bias  of  opposite  sign  at  Denver  and 
Alert,  and  produced  no  noticeable  bias  of  moisture  at  Hawaii  (but  failed  to 
capture  major  humidity  change  episodes). 

d.  Accurate  point  predictions  of  wind  speed  and  direction  in  the  boundary  layer 
appear  to  be  very  difficult  for  the  model  to  achieve,  although  systematic  wind 
prediction  errors  were  modest  (Hawaii)  or  non-existent  (Denver  and  Alert). 

e.  It  is  difficult  to  find  a  systematic  trend  or  pattern  of  error  in  the  boundary 
layer,  where  the  error  is  dominated  by  the  random  component. 

The  new  treatment  of  topography  and  the  land  surface  parameterization  in  PL-91 
has  utilized  the  enhanced  (silhouette)  topography.  Another  addition  to  the  PL  GSM 
in  PL-91  is  a  variable  soil  and  vegetation  classification  based  on  Wilson  and 
Henderson-Sellers30  and  Matthews31.  The  impacts  of  the  silhouette  topography 


30Wilson,  M.F.,  and  Henderson-Sellers,  A.  (1985)  A  Global  Archive  of  Land  Cover  and  Soils  Data 
for  Use  in  General  Circulation  Climate  Models,  J.  Climate,  5:119-143. 
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and  the  land  surface  parameterization  on  the  PBL  predictions  are  presently  subjects 
of  investigation  at  PL. 

In  Section  4.3,  we  introduced  map  plots  of  weather  predictions  produced  by 
GWC84  and  PL-91  for  the  1200  UTC  12  January  1979  case.  Figure  73  compares  the 
72-hour  forecasts  of  mean  sea  level  pressure  and  500  mb  height  with  the  verifying 
analysis.  In  this  case,  both  model  versions  reproduced  the  major  troughs  and  ridges 
fairly  well.  We  made  the  following  observations  when  we  watched  the  six-day 
forecast  color  animation  of  this  case. 

a.  PL-91  performed  well  in  predicting  intensity  and  location  of  several  surface 
lows. 

b.  PL-91  generally  predicted  mean  sea  level  pressure  better  than  GWC84. 

c.  Both  versions  failed  to  cut-off  troughs  and  ridges  in  500  mb  height,  and 
incorrectly  split  an  intense  north  Pacific  500  mb  trough. 

d.  PL-91  did  not  predict  the  500  mb  height  field  noticeably  better  than  GWC84. 

e.  PL-91  produced  an  overall  better  prediction  of  200  mb  jet  magnitude  and 
location  than  GWC84,  particularly  over  the  north  Pacific. 

We  show  only  one  case  of  tropical  weather  prediction  in  Figures  76  and  77,  for 
the  1200  UTC  10  June  1979  case.  On  the  basis  of  this  single  case,  it  appears  that 
PL-91  better  preserved  the  north-south  mean  sea  level  pressure  gradient  over  the 
Indian  Ocean  (Figure  76),  which  may  account  for  its  ability  to  better  represent  the 
higher  850  mb  wind  speeds  (Figure  77)  in  this  region.  As  a  result,  the  oval-shaped 
closed  circulation  south  of  India  (as  the  Indian  monsoon  develops)  is  better 
represented  by  PL-91. 

The  balance  of  the  weather  prediction  maps  shown  depict  the  predicted  humidity 
fields  for  12  January  over  the  Northern  Hemisphere  (Figures  74  and  75)  and  for 
10  June  over  the  tropical  Eastern  Hemisphere  (Figures  78-81).  In  January,  both 
versions  tend  to  produce  reduced  RH  at  850  mb  over  much  of  the  hemisphere  (this 


3lMatthews,  E.  (1983)  Global  Vegetation  and  Land  Use:  New  High  Resolution  Data  Bases  for 
Climate  Studies,  J.  Clim.  Appl.  Meteor.,  22:474-487. 
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is  better  seen  in  the  color-filled  graphics27).  This  is  not  as  evident  in  the  q  forecasts, 
where  we  see  the  dry  and  moist  features  well  reproduced  by  both  versions.  At  300 
mb,  both  versions  produce  RH  forecasts  that  are  more  moist  than  the  verification 
(Figure  75).  Again,  the  color-filled  graphics  make  this  more  clear,  showing  PL-91 
only  slightly  less  moist  than  GWC84.  Finally,  the  tropical  case  (Figures  79-81)  shows 
that  the  PL-91  version’s  tendency  to  be  too  dry  at  850,  too  moist  at  700,  and  too  dry 
at  400  mb  is  widespread,  not  concentrated  in  certain  geographic  locales. 

6.  SUMMARY  AND  RECOMMENDATIONS 

In  this  section,  we  summarize  the  major  findings  that  resulted  from  our 
experimentation  with  various  versions  of  the  PL  GSM.  We  focus  our  summary  on  the 
three  versions  GWC84,  GL-89,  and  PL-91,  which  were  the  most  completely 
scrutinized  in  this  report.  In  this  way,  we  summarize  the  progress  made  during  the 
10-year  process  culminating  in  PL-91.  Also,  we  included  in  this  summary  only  the 
features  revealed  by  more  than  one  of  the  scales  of  investigation  discussed  in  Section 
5. 

A  major  feature  of  the  GWC84  forecasts  was  the  pervasive  tropospheric  warm 
bias  that  was  especially  prominent  in  the  winter  hemisphere.  We  found  that  this 
warm  bias  tended  to  grow  seemingly  without  limit  through  the  10-day  forecast  period. 
We  attributed  this  bias  to  a  lack  of  a  radiation  parameterization,  which  tends  to 
produce  a  net  cooling  in  the  atmosphere.  GL-89  produced  a  more  modestly  growing 
cold  bias  in  the  mid-troposphere,  primarily  relegated  to  the  tropics,  but  also  apparent 
over  North  America.  The  introduction  of  a  new  convective  scheme  and  a  reduction 
of  the  radiative  cooling  in  PL-91  led  to  a  modest  mid-tropospheric  warm  bias  that  was 
larger  in  June  than  January.  At  very  low  levels,  a  warm  bias  was  apparent  over 
much  of  the  Northern  Hemisphere  continents  in  both  seasons.  At  high  levels  (above 
200  mb)  persistent  warm  bias  exists  in  the  forecasts  of  all  three  model  versions, 
indicating  a  modeling  shortcoming  not  addressed  by  the  new  physical 
parameterizations.  We  evaluated  only  the  performance  of  PL-91  extensively  in  the 
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boundary  layer.  It  seemed  unable  to  capture  synoptic  scale  warming  and  cooling 
episodes  in  the  boundary  layer.  Overall,  PL-91  appeared  to  have  the  edge  in 
temperature  forecast  accuracy. 

All  three  models  generated  a  systematic  error  in  humidity  that  was 
geographically  widespread.  In  GWC84,  a  dry  bias  was  found  in  the  lower 
troposphere,  a  moist  bias  in  the  mid-tropospheric  tropics,  a  dry  bias  in  the  mid- 
tropospheric  extratropics,  and  a  moist  bias  in  the  upper  troposphere.  GL-89  forecasts 
featured  a  moist  bias  in  the  mid  and  upper  troposphere  in  the  tropics,  and  a  moist 
bias  in  the  upper  troposphere  in  the  extratropics.  In  the  PL-91  forecasts,  the  tropical 
bias  had  a  vertical  bimodal  structure;  dry  at  850  mb,  moist  at  700  mb,  dry  at  400  mb, 
and  significantly  moist  at  300  mb.  This  upper  level  moist  bias  was  in  fact  present 
at  all  latitudes  in  PL-91.  Low  level  moisture  biases  over  land  were  seasonal, 
generally  moist  in  January  and  dry  in  June.  Although  humidity  prediction  accuracy 
is  lacking  in  all  three  model  versions  (synoptic  scale  variations  were  a  problem  in 
moisture  forecasts,  too),  PL-91  was  judged  the  best  in  January  and  GL-89  in  June 
based  on  Northern  Hemisphere  statistics. 

We  found  that  wind  prediction  skill  was  difficult  to  judge,  particularly  in  the 
boundary  layer.  In  general,  the  bias  in  either  wind  component  or  the  speed  was 
small  compared  to  the  RMSE.  Wind  speed  biases  were  very  localized  and  appeared 
at  different  locations  at  different  atmospheric  levels.  Overall,  PL-91  forecasts 
appeared  to  have  the  smallest  jet-level  RMSEs  in  winds,  particularly  in  the  winter 
hemisphere.  PL-91  also  appeared  to  produce  the  smallest  lower-tropospheric  wind 
RMSEs,  particularly  in  the  tropics.  The  former  improvement  we  attribute  to  the 
introduction  of  the  gravity  wave  drag  formulation,  and  the  latter  to  the  cumulus 
momentum  drag  formulation  in  the  ECMWF  convection  parameterization.  We  found 
that  PL-91  (and  we  expect  the  other  versions  as  well)  was  generally  unable  to 
reproduce  the  variations  seen  in  the  analyzed  winds  in  the  boundary  layer,  most 
noticeably  those  of  synoptic  scale.  However,  we  found  no  evidence  of  a  systematic 
bias  in  boundary  layer  wind  forecasts. 
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Weather  pattern  prediction  assessment  was  limited  to  a  single  case.  Even  so,  PL- 
91  seemed  to  represent  surface  pressure  patterns  better  than  GWC84,  but  was  not 
noticeably  better  at  500  mb.  We  saw  somewhat  better  jet  positions  and  intensities 
in  PL-91  than  in  GWC84.  However,  each  model  had  its  wide-spread  and  persistent 
moisture  biases  mentioned  earlier  that  obscured  pattern  prediction. 

On  the  basis  of  these  preliminary  assessments,  we  recommend  that  PL-91  be 
advanced  as  the  new  baseline  version  of  the  PL  GSM.  More  innovative  ways  of  using 
observations  are  needed  to  accurately  evaluate  the  nature  of  both  its  systematic  and 
random  error.  We  recommend  that  the  model  be  executed  at  a  higher  horizontal  (and 
commensurate  vertical)  resolution,  to  represent  state-of-the-art  operational  center 
resolutions.  This  will  require  that  the  optimization  of  the  PL  GSM  be  extended  to  the 
PL-91  version  and  then  extensively  tested.  Such  an  effort  is  already  underway  at  PL 
in  a  combined  in-house  and  contractor  effort. 

As  for  improvements  in  PL-91,  we  recommend  that  the  cumulus  convection  and 
boundary  layer  schemes  be  further  tuned  to  reduce  what  appears  to  be  excessive 
precipitation,  especially  in  the  tropics.  The  moisture  biases  in  the  model  should  be 
investigated  as  to  their  source  and  causative  factors.  Such  an  investigation  is  in 
process  and  will  be  reported  on  soon.  We  recommend  that  a  cloud  diagnosis  scheme 
tuned  for  PL-91  (perhaps  the  Mitchell  and  Hahn19  scheme)  be  adopted  for  use  in 
conjunction  with  the  model’s  radiation  parameterization  in  an  attempt  to  further 
alleviate  temperature  biases.  Another  PL  effort  is  currently  underway  to  use  the  PL- 
91  version  to  attempt  to  develop  an  improved  statistical  cloud  diagnosis  scheme  that 
can  be  developed  from  statistics  any  model  may  generate  (that  is,  be  model  specific 
in  its  values  but  generic  in  design).  Ultimately,  we  recommend  that  future  versions 
of  the  PL  GSM  be  considered  for  extension  to  prognostic  cloud  forecasting  as  the 
physical  parameterizations  of  the  model  continue  to  improve. 
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APPENDIX  A 
Topography  Representations 


There  are  three  kinds  of  topography  representation  commonly  used  in  global 
numerical  models:  (1)  mean  topography,  hlf  (2)  envelope  topography,  h2,  and  (3) 
silhouette  topography,  h3.  Their  definitions  are  as  follows. 
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where  h  (i J)  is  the  actual  terrain  height  at  subgridpoints  (i  j)  for  a  grid  box,  and  h, 
is  the  mean  terrain  height  for  which  the  standard  deviation  of  the  terrain  height  at 
that  gridpoint  is 
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The  envelope  topography  is 
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h2  =  *  Cah 


where  C  is  a  constant,  usually  between  1.0  and  2.0.  The  so-called  silhouette 
topography  (orography)  is 


A3  =  Vfe 


M  U  1 


where  h(  is  the  maximum  height  of  the  subgrid  terrain  profile  in  each  y-z  plane,  and 
hj  is  the  maximum  height  of  the  profile  in  each  x-z  plane  in  the  grid  box.  M  and  N 
are  the  number  of  subgridpoints  within  a  grid  box  in  x  and  y  directions,  respectively. 

In  the  early  days  of  global  numerical  weather  prediction,  h,  was  used.  The  mean 
orography,  h„  computed  as  an  arithmetic  average  of  points  over  the  model  grid  was 
found  to  underestimate  the  blocking  effects  of  high  mountains.  Later,  the  enhanced 
orography  (envelope  and  silhouette  orography)  was  introduced  in  order  to  overcome 
the  deficiencies  due  to  mean  orography.  Many  researchers  (for  example,  Mesinger 
and  Collins32)  have  described  the  impacts  of  the  enhanced  orography. 

PL-91  adopts  the  silhouette  orography,  which  was  considered  better  than  envelope 
orography  in  dealing  with  the  gravity  wave  parameterization.14 


3SMesinger,  F.  and  Collins,  VV.G.  (1987)  Review  of  the  Representation  of  Mountains  in  Numerical 
Weather  Prediction  Models,  Observation ,  Theory,  and  Modeling  of  Orographic  Effects,  15-20  September 
1986,  Volume  2,  ECMWF,  Shinfield  Park,  Reading,  U.K. 
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